When a provider has no API: the flight system’s crawlers

At Tadbir Paydar Pars, the web service behind the complete flight system was connected to Travelport, Skyscanner, Mahan Air, Raviss, Sepehr, Alibaba and several other providers. Only some had an API; the rest we had to read the way a user does.

A crawler you can rely on

A crawler must know that a page has changed, not return an empty answer. Each provider had an adapter that turned its output into one shape, and any change in a page’s structure raised an alert.

From B2B to B2C

On the same web service we built a white-label B2C edition, and later a referral-marketing module with commissions and payouts.