Fifty-plus sources.
One analytical store.

We built an AWS data platform for a market and financial research firm: connecting external sources, preparing linked records in ClickHouse, and giving analysts a workspace to query and explore them.

Swipe across the demo to explore.

Ask in plain language. Read the SQL. Run it, explore the answer and add a chart to a dashboard.

Faster queries.
More finished research.

Outcomes from the
client’s project account.

4×

Faster queries on average

Across the research firm’s analytical queries.

40%

More tasks completed

By the same analytics team.

75%

Revenue growth reported by the client

The firm attributes this growth to faster, more accurate analysis.

15M

Records ingested a day

From more than 50 sources, 550 TB stored.

Revenue attribution reflects the client’s assessment of faster, more accurate analysis.

The analysis started
after the data hunt.

Different formats. Different schedules. The same company under different names. Analysts spent time collecting and reconciling records before they could research a market.

What Cursopic built.

Connected external data.

We connected the S3 lake, databases, registries, APIs and scrapers through streaming and scheduled ingestion.

Prepared a shared store.

Spark cleans, deduplicates and links records before they enter the ClickHouse analytical store.

Built the analyst workspace.

Readable SQL, plain-language questions, dashboards, notebooks and search sit on the prepared data.

Different sources.
Prepared to work together.

A question runs against data already in the analytical store. Ingestion and preparation happen before the analyst asks.

  1. Connect the sources.

    >50sources

    S3 data lake, company databases, public registries, APIs and scrapers.

    Kafkastreaming

    Airflowscheduled loads

  2. Prepare records together.

    ~15Mnew records / day

    Spark cleans and deduplicates records, links the same company across sources, and prunes unused data.

    Shared preparation before the research question.

  3. One store. Room to investigate.

    ClickHouse

    550 TBstored

    Prepared, linked data in one analytical store.

    The analyst’s workspace

    SQL, dashboards, notebooks, search and plain-language-to-SQL.

    Read, check and change the SQL before running it.

Built on AWS. Sources keep their own delivery schedules; analysts query the prepared store.

From a record
to a research decision.

Inspect a query, trace a company’s sources, explore a market or check a feed. Four views of the same connected platform.

Swipe across the demo to explore.

A query you can check.

The workbench shows the schema beside existing SQL. An analyst inspects the query, changes ORDER BY and runs it again.

An answer you can explore.

The results reorder and the chart exposes detail. Plain-language SQL generation is shown in the opening tour.

The decisions
behind one query.

  • Prepare once.
    Ask many questions.

    Cleaning and entity linking happen in the pipeline. Analysts query records already prepared for use together.

  • Different schedules.
    One data model.

    Kafka streams and Airflow loads feed the same processing path. Each source keeps its own delivery cadence.

  • Keep what matters.
    Prune what doesn’t.

    Pruning unused data was part of the platform, alongside source status and pipeline monitoring.

The foundation first.
Then the working day.

Four months of development and one month of support for this project, from connecting the sources to helping analysts move their work over.

  • 4months of development

    From sources to analyst tools.

    1. 01

      Sources and ingestion

    2. 02

      Processing

    3. 03

      Store and tools

    4. 04

      Search and launch

  • 1month of support

    Make the move into daily use.

    We stayed with the team as analysts moved their work onto the platform, helping with the switch and tuning the parts they found slow.

    Analysts moved queries and reporting into the connected workspace.

Let’s build your next advantage

Tell us what you want to launch, improve or automate. Let’s discuss the scope and the next step.

Get in touch

Prefer email?

sales@cursopic.com

Cursopic

Tell us about your project

What would you like to launch, improve or automate? A few lines are enough to start.

We use what you send only to reply to you about your request. Privacy policy (opens in a new tab)

Prefer email?

sales@cursopic.com