Real pipelines, built on the DataLug canvas

Review popular use cases from different industries. Each shows the connectors involved, the nodes on the canvas and how branching sends every record to the right place. Describe any of them to Milo to get a draft.

  • Source
  • Filter and branch
  • Transform
  • Checkpoint
  • Target
  • Notify

Supplier order reconciliation

A retailer picks up supplier files each night, matches them to open orders, and sends the exceptions to whoever fixes them.

SFTPPostgreSQLGoogle SheetsSlack

ASK MILO

“Every night, match supplier CSVs on SFTP to our orders and flag anything that doesn’t match.”

SOURCESFTPsupplier_*.csv
TRANSFORMParse and matchon order_id
BRANCHMatched?order_id found
matched
TARGETPostgreSQLorders.receipts
no match
TARGETGoogle SheetsExceptions
NOTIFYSlack#ops
Workflow on the DataLug canvas

Closed-won deals to warehouse and finance

A B2B software company loads won opportunities into Snowflake every night. Finance hears about a large deal the moment it lands.

SalesforceSnowflakeMicrosoft Teams

ASK MILO

“Sync closed-won opportunities to Snowflake nightly and tell finance about deals over $50k.”

SOURCESalesforceOpportunity
FILTERClosed wonStageName
BRANCHDeal sizeAmount
≥ 50k
TARGETSnowflakeSALES.OPPS
NOTIFYTeamsFinance
else
TARGETSnowflakeSALES.OPPS
Workflow on the DataLug canvas

Route inbound leads by region

An agency routes each new marketing contact to the sales CRM covering its region. Anything that does not match is flagged for review.

HubSpotPipedriveZoho CRMSlack

ASK MILO

“Send new HubSpot contacts to Pipedrive for North America and Zoho for EMEA.”

SOURCEHubSpotNew contacts
TRANSFORMNormalise countryISO codes
BRANCHRegioncountry
N. America
TARGETPipedriveDeals
EMEA
TARGETZoho CRMLeads
other
NOTIFYSlack#sales-review
Workflow on the DataLug canvas

Escalate urgent tickets to engineering

A support team opens an engineering issue for urgent tickets and pages on-call. Every ticket still lands in the warehouse.

ZendeskJiraSlackSnowflake

ASK MILO

“When a Zendesk ticket is urgent, open a Jira issue and post to #on-call.”

SOURCEZendeskTickets
FILTERChanged sincelast run
BRANCHPriorityticket.priority
urgent
TARGETJiraENG issue
NOTIFYSlack#on-call
else
TARGETSnowflakeSUPPORT.TICKETS
Workflow on the DataLug canvas

Replicate the ERP for reporting

A manufacturer copies changed work orders from Oracle into PostgreSQL incrementally, and quarantines the rows that fail validation.

Oracle DatabasePostgreSQLSMTP

ASK MILO

“Copy new and changed Oracle work orders into Postgres every hour and email us about bad rows.”

SOURCEOracleWORK_ORDERS
CHECKPOINTSince last runupdated_at
BRANCHRow valid?schema rules
valid
TRANSFORMMap types14 columns
TARGETPostgreSQLreporting.wo
invalid
TARGETPostgreSQLreporting.rejects
NOTIFYEmailData team
Workflow on the DataLug canvas

Proof-of-delivery file intake

A logistics operator reads delivery files as drivers upload them, loads the good ones and archives the originals. Dispatch hears about the failures.

Amazon S3SQL ServerAzure Blob StorageMicrosoft Teams

ASK MILO

“Load proof-of-delivery files from S3 into SQL Server, archive them, and alert dispatch if one fails.”

SOURCEAmazon S3pod/incoming/
TRANSFORMExtract fieldsCSV to rows
BRANCHSchema checkrequired fields
pass
TARGETSQL Serverdbo.Deliveries
TARGETAzure Blobarchive/
fail
NOTIFYTeamsDispatch
Workflow on the DataLug canvas

Month-end ledger consolidation

An accounting team combines branch ledgers into one close summary, and sends anything outside tolerance to the controller.

SharePointGoogle SheetsSMTP

ASK MILO

“Total the branch ledgers in SharePoint into a summary sheet and email the controller about variances over 2%.”

SOURCESharePointClose/Ledgers
TRANSFORMNormalise, totalby branch
BRANCHVariancevs. budget
> 2%
TARGETGoogle SheetsReview
NOTIFYEmailController
≤ 2%
TARGETGoogle SheetsClose summary
Workflow on the DataLug canvas

One clean donor database

A nonprofit turns event sign-up sheets into donor records. New people are inserted, known ones updated, bad data flagged.

Google SheetsMySQLSlack

ASK MILO

“Add new event sign-ups to our donor database and update people we already have.”

SOURCEGoogle SheetsEvent sign-ups
TRANSFORMClean emailslowercase, trim
BRANCHKnown donor?match on email
new
TARGETMySQLdonors insert
existing
TARGETMySQLdonors update
bad email
NOTIFYSlack#data
Workflow on the DataLug canvas

Lease renewal follow-ups

A property manager reads lease end dates out of stored documents and starts renewal follow-ups 60 days ahead.

DropboxFreshsalesPostgreSQLMicrosoft Teams

ASK MILO

“Find leases in Dropbox ending within 60 days and create a renewal task in Freshsales.”

SOURCEDropboxLeases/
TRANSFORMRead end dateslease metadata
BRANCHEnds indays from today
≤ 60 days
TARGETFreshsalesRenewal task
NOTIFYTeamsLeasing
later
TARGETPostgreSQLleases
Workflow on the DataLug canvas

Moderation reports to the right queue

An online community pulls open reports from its platform API, opens tracked cases for the serious ones, and keeps moderators informed.

REST APIJiraDiscord

ASK MILO

“Every 15 minutes, send high-severity reports to Jira and post all new reports to our mods channel.”

SOURCEREST APIGET /reports
FILTERStatus openstatus = open
BRANCHSeverityreport.severity
high
TARGETJiraTrust and Safety
NOTIFYDiscord#mods
low
NOTIFYDiscord#mod-queue
Workflow on the DataLug canvas

Salesforce as the source of truth for support and marketing

A SaaS operations team keeps Salesforce as the source of truth. When an account changes there, customers are updated in Zendesk and prospects in HubSpot.

SalesforceZendeskHubSpotSlack

ASK MILO

“When a Salesforce account changes, update customers in Zendesk and prospects in HubSpot.”

SOURCESalesforceAccount
CHECKPOINTChanged sinceLastModifiedDate
BRANCHAccount typeType
customer
TRANSFORMMap to org8 fields
TARGETZendeskOrganizations
prospect
TRANSFORMMap to company6 fields
TARGETHubSpotCompanies
no match
NOTIFYSlack#revops
Workflow on the DataLug canvas

Reverse ETL to Salesforce, and archival back to Snowflake

An enterprise data team runs two workflows against one warehouse. Account scores modelled in Snowflake go into Salesforce every hour, and closed cases older than two years move out of Salesforce into Snowflake each month.

SnowflakeSalesforceSlackSMTP

ASK MILO

“Update Salesforce accounts hourly with health scores from Snowflake, and archive cases closed over two years ago to Snowflake monthly.”

REVERSE ETL · HOURLY
SOURCESnowflakeANALYTICS.SCORES
TRANSFORMMap to fieldsHealth, Tier
BRANCHAccount found?match on Id
matched
TARGETSalesforceAccount update
no match
TARGETSnowflakeSCORES_UNMATCHED
NOTIFYSlack#data
ARCHIVAL · MONTHLY
SOURCESalesforceCase
FILTERClosed > 2 yearsClosedDate
BRANCHLoad resultrows written
loaded
TARGETSnowflakeARCHIVE.CASES
TARGETSalesforceMark archived
failed
NOTIFYEmailSalesforce admin
Workflow on the DataLug canvas

Build the pipeline you have in mind

Describe it to Milo in the free trial, or tell us which system you need connected.