Cloudify: Lighthouse — Workflow Engine
A workflow automation engine similar to Zapier, enabling clients to connect disparate SaaS systems without custom code. Built trigger-action pipelines between HubSpot/Pipedrive CRM and Zoho Invoice for automated billing, Airtable for data sync, Brevo for marketing campaigns, and Twilio for SMS/WhatsApp notifications. Deployed on AWS Serverless with Celery/Redis for distributed task processing.
Tech Stack
Python Django Celery Redis AWS Lambda REST APIs
Project Insights
Challenges
- Designing a generic trigger-action engine that works across diverse APIs
- Handling rate limits, retries, and error recovery across 10+ third-party systems
- Data transformation between incompatible schemas (CRM → invoicing → marketing)
- Ensuring idempotent execution for reliable workflow runs
Outcomes
- Shipped multiple client integrations across CRM, invoicing, CMS, and messaging platforms
- Reduced manual data entry between systems for enterprise clients
- Distributed async processing with Celery/Redis for reliable workflow execution
- Deployed on AWS Serverless with automatic scaling