Partnership Announcement InfinyOn and MotherDuck Announce Strategic Partnership

Press Release

Build robust event-driven data pipelines for
log processing. data enrichment. IoT edge processing. clickstream analytics. real-time microservices.

Lightweight steam processing platform written in Rust and extended by WASM for unmatched speed and flexibility.

apiVersion: 0.1.0
meta:
  version: 0.2.3
  name: helsinki-mqtt 
  type: mqtt-source
  topic: helsinki
mqtt:
  url: "mqtt://mqtt.hsl.fi"
  topic: "/hfp/v2/journey/ongoing/vp/+/+/+/#"
  timeout:
    secs: 30
    nanos: 0
  payload_output_type: json
transforms:
  - uses: infinyon/[email protected]
    with:
      spec:
        - operation: shift
          spec:
            payload:
              VP:
                veh: "vehicle"
                spd: "speed"
  - uses: infinyon/[email protected]
    with:
      mapping:
        table: "speed"
        map-columns:
          "lat":
          "vehicle":
            json-key: "vehicle"
            value:
              type: "int"
              required: true
          "speed":
            json-key: "speed"
            value:
              type: "float"
              required: true
version: 0.1.0
meta:
  name: dedup-bus-events
deduplication:
  bounds:
    count: 1000000
    age: 24h
  filter:
    transform:
      uses: infinyon-labs/[email protected]
apiVersion: 0.1.0
meta:
  name: avg-vehicle-last-5-minutes
materialize:
  window:
    type: tumbling
    bound: "5min"
  compute: 
    uses: "infinyon-labs/[email protected]"
    with:
      group_by:
        - vehicle_id
      operation: 
        type: average
        param: speed
        result: avg_speed
apiVersion: 0.1.0
meta:
  version: 0.1.0
  name: md-helsinki
  type: duckdb-sink
  topic: helsinki
  secrets:
    - name: MD_TOKEN
duckdb:
  url: "md:?token=${{ secrets.MD_TOKEN }}"

Newsletter

Subscribe to our newsletter to keep up with the latest news and upcoming releases.

Why you need a unified data platform?

  • reduce complexity

    Reduce
    Time and Complexity

    Tired of babysitting a bunch of tools and infrastructure to build basic data pipelines? We are as well!

  • improve dev experience

    Improve
    Development Experience

    Work on the data insights instead of endlessly debugging failed jobs and lost data.

  • ship scalable data flows

    Deliver
    Continuous Data Flows

    Deliver data flows with state management, delivery guarantees, and high quality data continuously.

What's the state of your data pipelines?

Are you experiencing the pain of building and maintaining reliable data pipelines? Do you spend 80% or more of your time fixing issues with broken data pipelines? The complexity of your data stack is the usual suspect.
Kafka, Flink, Airflow - data pipeline spagetti

Build reliable data flows

Roll-out end-to-end data pipeline in minutes with simple YAML configurations. Create custom flows with development kits. If you build and maintain analytical data pipelines that deliver insights, our unified data platform will transform your data stack!
InfinyOn data streaming pipeline

Simplify your data stack

Unify the flow of data collection, transformation, and distribution using a new set of flexible and powerful primitives built entirely on Rust and extended by WASM.

Compose reliable data flows that are rich and complex yet operate with simplicity.

Technology Leaders Experience

By adopting InfinyOn Cloud, we've transformed our engineering velocity and eliminated the roadblocks and delays associated with traditional systems and services, empowering our teams to focus on innovation and growth.

CTO of Klarian
Ben Cleary
CTO of Klarian

Building blocks of reliable data pipelines

Collect

Collect your data with built-in connectors, webhooks, and IoT collectors, or build your own custom clients.

Transform

Apply transformations in-line as your data traverses the pipelines. Use pre-built SmartModules from the Hub or build your own with SMDK.

Deduplicate

Apply duplication for exactly-once semantics. Choose our certified pre-built algorithms or build your own.

Materialize

Materialized views are in early development and the interfaces presented here are subject to change. Join us on Discord to give us feedback.

Dispatch

Send data to multiple destinations with build-in certified connectors, your own custom connectors, or your full featured consumer clients.

What data practitioners say

  • CEO and Author

    Artem

    Data Platform Architect


    "I would love a unified solution without the memory limitations of JVM based tools."

  • Cloud Architect

    Joao

    Cloud Infrastructure Architect


    "It was awesome to see the CLI experience. That's like a million times better than Kafka. I think it's uncomfortable how much better it is than the Kafka."

  • CEO and Author

    Jowanza

    Data Practitioner, CEO, Author


    "The event based approach without babysitting a bunch of point solutions is the way I want to build."

Ditch the duct tape data stack

Each additional tool in your stack...

Reduce the value of data
Reduce
the value of data.
Consume extra resources
Consume
extra resources.
Add extra layers of integrate.
Add
extra layers to integrate.
Increase operational complexity
Increase
operational complexity.

Find out what your data platform could become

Struggling with the performance and cost challenges of your data stack?
Burdened with the quirks of Kafka, MQTT, Spark, Flink, FiveTran, DBT etc.?

We have the software and infrastructure engineering solution to the data plumbing problem! We would love to show you what InfinyOn and Fluvio can do for you.