Running Multi FileFeeds in production

Once the agent has produced the right output against a test file and you've reviewed and approved the proposed transforms, the next step is operating the Multi FileFeed in production. That means deciding when it runs, how new versions reach customers, and how you find out when something goes wrong. This page walks through the operational surface.

The agent does the work of building the pipeline. The settings on this page govern how that pipeline executes once it's live.

Saving and promoting versions

Unsaved changes in the transform builder don't run for real imports. To put changes into production:

  1. From the transform builder, Save your changes. This creates a new saved version of your transforms (including anything the agent proposed and you accepted).
  2. From the MFF's settings, promote the saved version to the next environment (Development → Staging → Production, or whatever ladder your organization uses).
  3. Verify in the target environment by triggering a test import.

Promotion is explicit (there's no automatic mirroring between environments). This means the version running in Production is exactly the version you've signed off on. For the environment model, see Using Environments.

Templates have their own per-environment versioning (a template is pushed to Production independently of the MFF). When you promote an MFF version, make sure the templates it references have also been promoted.

Scheduling recurring runs

For sources that support it (SFTP, S3, Google Sheets, Azure SharePoint), OneSchema can pull files on a schedule:

  • Hourly. Useful for frequent partner drops.
  • Daily. The default for nightly batch flows.
  • Custom cron-style schedules. For cases that don't fit the standard cadences.

Configure the schedule on the source connection inside the MFF's settings. When the schedule fires, OneSchema checks the source for new files, creates one MFF import per file (or per batch), and runs the latest saved version of your transforms against each.

If the source has no new files at the scheduled time, the run is a no-op: nothing is imported and no destination delivery is attempted.

Triggering runs from your app

Schedule-based runs are great for recurring intake, but a lot of integrations are event-driven: your app needs to push a file right now. For those, your app triggers an MFF run via the API:

  1. Create an import on the MFF.
  2. Attach files (direct upload or upload-from-S3).
  3. Submit the import for processing.

The same pattern works from an AWS Lambda function, a Cloud Functions handler, a webhook your app receives, or any backend code path. See the Multi FileFeeds API reference for the full endpoint contract.

Event webhooks

OneSchema can POST events back to your application when an MFF import resolves:

  • multi_file_feed_import_success. The import completed successfully and (if a destination is configured) the destination delivery has been attempted.
  • multi_file_feed_import_error. The import failed; the payload includes the failure reason.

Configure event webhooks under Settings → Event webhooks; they apply across all MFFs in the organization. For per-MFF event delivery, see Using Event Webhooks.

Monitoring runs

The MFF's runs page shows every recent import, with status, row counts, and per-template outcomes. From any individual run you can:

  • See which transforms produced which outputs.
  • Inspect per-cell validation errors and warnings.
  • Re-run the import without re-uploading the file (useful after you've fixed a transform).
  • Download the validated output for manual inspection.

For organization-wide visibility, the USAGE TRACKING section covers how to track file usage and credits across your account.

Re-running and recovery

A failed run can almost always be re-run after you've fixed the underlying issue:

  • Saved-version regression. Revert to a prior saved version, or roll forward a fix (often by re-running the agent against the failing reference file).
  • Source file issue. Fix the source file and re-create the import.
  • Destination delivery failure. Re-trigger destination delivery without re-running the transforms (the validated output is already produced).
  • Transient failure. Many transient failures auto-retry; for the rest, re-running the import is safe and idempotent.

What good operations looks like

A few habits that pay off:

  • Staging first. Every change to a saved version (including anything the agent newly proposed) should first run against real-shaped data in Staging before promoting to Production.
  • Alert on import failure. Pipe the import-failure event webhook to your incident channel so failures don't sit unnoticed.
  • Track credits. USAGE TRACKING shows how much compute and AI usage each MFF consumes. Surprises here are usually a sign that a transform is doing more work than expected.

For deeper coverage of any of the above, follow the linked guides.