Insights
Latest Thinking From The Team
Nov 20, 2024
General
Loan Origination
Introduction Loan application fraud in the UK has become an increasing concern for financial institutions and regulatory bodies. This type…
Nov 12, 2024
General
Integrating AWS Bedrock and MongoDB - Part 1 - RAG
Introduction In these articles we aim to demonstrate two different ways for integrating AWS Bedrock with MongoDB Atlas , the cloud hosted…
Nov 9, 2024
General
AI Automation For The Individual and The Back Office
When it comes to adopting AI in business, we believe there is a useful distinction to be made between how AI can help individual employees…
Nov 8, 2024
General
Using AI For Automation and Risk Detection in Trade Finance Compliance
A Digital Foundation in Trade Finance Compliance A little over a year has passed since the UK Electronic Trade Documents Act came into…
Oct 8, 2024
General
Your AI Prompts As The Operating System For Your Business
We believe that businesses will eventually build a library of "prompts" which describe all of their end to end processes and decision making…
Sep 26, 2024
General
Using AI For Intelligent Automation
We were recently asked a probing question by a CIO - “What can AI automate for me that I couldn’t achieve with other simpler automation…
Sep 17, 2024
General
Using Generative AI To Enhance Recommendation Systems
Recommendation systems work by analysing the historical behaviours of customers (and similar clusters of customers) in order to generate…
Sep 11, 2024
General
Integrating Large Language Models With Human Workflow To Identify Vulnerable Customers
Large Language Models (LLMs) are most often associated with the chatbot style interface popularised by ChatGPT. This involves a user…
Sep 11, 2024
General
Integrating Large Language Models With Human Workflow To Identify Vulnerable Customers
Large Language Models (LLMs) are most often associated with the chatbot style interface popularised by ChatGPT. This involves a user…
Jul 15, 2024
General
Addressing The $125bn First Party Fraud Challenge using AI & Machine Learning
“First-party fraud”, sometimes referred to as “friendly fraud”, is any fraud that is initiated directly by a customer, rather than a third…
Jun 6, 2024
General
Using Large Language Models For Data Enrichment In Financial Crime and Compliance
Many businesses find themselves under near-constant attack from criminals seeking to commit financial crimes such as fraud, scams, and money…
May 13, 2024
General
Using Cube And ClickHouse To Power Data Applications In Financial Services
Last week we delivered a webinar with the Cube team, covering why we believe that Cube is an excellent fit for building data-oriented…
Apr 22, 2024
General
The Problems With Legacy AML Technology
The Ministers of the Financial Action Task Force (FATF) met for their biannual meeting in Washington D.C on the 18 April 2024, ultimately…
Apr 18, 2024
General
Using AI To Combat Terrorist Financing And Money Laundering
The geopolitical turmoil in recent months is a painful reminder that sanctioned regimes, companies, groups and persons are still able to…
Apr 9, 2024
General
Benjamin Wootton and Pontus Noren Unveil Ensemble AI
We are pleased to announce the launch of Ensemble AI , a professional services business dedicated to helping enterprises deploy and adopt…
Mar 20, 2024
General
How Large Enterprises Can Approach An AI "Transformation"
Though AI has been around for decades, it experienced a massive uptick in interest in November of 2022 with the release of ChatGPT. At…
Mar 15, 2024
General
Using Advanced Analytics To Overcome Challenges In Financial Crime Technology
It is estimated that more than 50% of businesses have been a victim of financial crime , with total global losses amounting to a remarkable…
Mar 8, 2024
General
Calculating Value At Risk For An Equities Portfolio Using ClickHouse
ClickHouse is increasingly being used by capital markets firms such as investment banks, hedge funds and trading technology vendors…
Mar 7, 2024
General
ClickHouse Is The Spiritual Successor To KDB+
In a recent article we explained how ClickHouse is growing in adoption within capital markets businesses such as investment banks, hedge…
Feb 26, 2024
Tools
Building A Recommendation System Using ClickHouse and SQL
In recent blog posts we demonstrated how data science techniques such as forecasting and anomaly detection can be implemented entirely…
Feb 19, 2024
Tools
Why Prompt Engineers and LLMOps Engineers Will Become Real Job Titles
When I first heard the term "prompt engineering" I laughed. Surely we didn't need specialist skills to play with ChatGPT? Likewise with…
Feb 17, 2024
Tools
Introducing EnsembleJS, Our Low Code Framework For Developing Real Time Data Applications
EnsembleJS is our new low-code framework which we use to rapidly develop real-time data applications powered by ClickHouse. It…
Feb 16, 2024
General
Building An Intelligent Agent With AWS Bedrock
In this article we will introduce the powerful agent functionality of AWS Bedrock. We will begin by introducing core concepts, then move…
Feb 7, 2024
Tools
Solving A Workforce Optimisation Problem With ClickHouse Cloud and Google OR-Tools
In a recent blog post we looked into a data science problem involving optimising how to route delivery vehicles around the country in the…
Feb 5, 2024
General
Optimising Vehicle Routing Using ClickHouse Cloud And Google OR-Tools
Operational Analytics is about using real time data to make better day to day decisions. It involves looking at the state of the world…
Jan 28, 2024
Tools
Using ClickHouse Cloud As A Real Time Data Warehouse
When you think of data warehouse technology, you may think of legacy on premise offerings such as Oracle or Terradata, or more modern cloud…
Jan 22, 2024
Machine Learning
Using ClickHouse Cloud To Power ML Feature Stores - A Fraud Detection Example
In a recent blog post we walked through the process of combining AWS SageMaker with ClickHouse to develop and deploy a machine learning…
Jan 17, 2024
General
How ClickHouse Cloud Simplifies Your Data Stack
In recent years, many data teams bought into the modern data stack tooling and philosophy. This involved combining a number of fully…
Jan 17, 2024
General
Open Table Formats Are Inevitable For Analytical Datasets
How open data formats such as Iceberg, Delta and Hudi are a compelling approach for businesses.
Jan 9, 2024
General
Combining Large Language Models With Real Time Data
In this video we explain how large language models can be used to interrogate a real time analytical database, in this case ClickHouse Cloud…
Jan 6, 2024
General
A Real World Business Application Of LLMs and GenAI (Video)
In this video, we demonstrate a real world example of how LLMs can be used in the financial services industry. We're going to be using the…
Jan 6, 2024
General
Transforming Financial Services With Generative AI (Video)
In this video, we demonstrate a real world example of how LLMs can be used in the financial services industry. Our aim was to bring to life…
Dec 20, 2023
General
Why ClickHouse Cloud Is A Good Fit For Machine Learning
Developing machine learning models can require and produce significant amounts of data. This includes training datasets, results of…
Dec 15, 2023
Tools
Ensemble And QRI Partner To Help Businesses Become More Secure And Compliant
We are pleased to announce our partnership with Quantum Resilience International . QRI are business that specialise in supporting family…
Dec 8, 2023
General
ClickHouse Cloud And Hex Are A Great Stack For Analytics And Data Science
ClickHouse Cloud and Hex are fast becoming our preferred stack for doing data analytics and data science. Together, they provide a fully…
Dec 7, 2023
General
Combining ClickHouse Cloud And AWS SageMaker For Machine Learning
In previous articles, we looked at performing machine learning tasks such as forecasting and anomaly detection directly within…
Dec 6, 2023
General
Integrating Large Language Models With Real Time Analytics (Video)
In this video, we demonstrate how large language models can be integrated with a real time analytical database, in this instance ClickHouse…
Dec 3, 2023
General
Combining Cube And ClickHouse For User Facing Analytics
The high performance of ClickHouse makes it particularly suitable for user-facing analytics use cases. This is where we embed analytics…
Dec 1, 2023
General
Introducing AWS Bedrock, Knowledge Bases And Agents
In this video, we introduce AWS Bedrock, which is a new service for working with large language models (LLMs). We begin by introducing…
Nov 13, 2023
General
Why Cloud Data Warehouses Are Too Expensive For Emerging Data Requirements
ClickHouse recently published an excellent article describing how cloud data warehouses such as Snowflake and Redshift are coming under…
Nov 7, 2023
General
Time Series Classification Using ClickHouse Machine Learning Functions
This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…
Nov 6, 2023
General
Linear Regression Using Clickhouse Machine Learning Functions
This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…
Oct 23, 2023
General
Comparing ClickHouse Cloud With Snowflake Pricing
Introduction In this article we analyse the differences in pricing between Snowflake and ClickHouse Cloud , with the aim of comparing TCO…
Oct 17, 2023
General
Anomaly Detection Using ClickHouse
This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…
Oct 15, 2023
General
Forecasting Using ClickHouse Machine Learning Functions
This article is part of a series where we look at doing data science work within ClickHouse . Articles in this series include forecasting…
Oct 12, 2023
ClickHouse
How We Built A Crypto Analytics Platform Based On ClickHouse
One of our most significant projects with ClickHouse involved developing an analytics platform for Crypto and Web3 data. The aim of the…
Oct 7, 2023
General
Why ClickHouse Cloud Disrupts The Data Warehouse Industry
In recent years, when I have been asked by businesses which data warehouse to choose, there were 3 candidates at the top of the list…
Oct 6, 2023
General
The New Architecture For Cloud Native Data
The architectural patterns for building and managing data warehouses in the cloud are changing dramatically. These changes are likely to be…
Jun 17, 2023
ClickHouse
Combining dbt And ClickHouse
dbt is a popular open-source tool that is used for defining and running data transformations within data warehouses. Typically, it has…
Jun 8, 2023
Ensemble CI
Using Git Branches And Pull Requests As Part Of Your dbt Workflow
How using source control, Git and branching and merging strategies can improve your data delivery.
Jun 1, 2023
ClickHouse
Why We Went "All In" On ClickHouse
Historically, enterprise data and analytics systems have been built around batch processing. This involves collecting new data into batches…
May 9, 2023
Ensemble CI
Using Multiple Databases For Your dbt Workflow
How introducing multiple databases as part of a dbt deployment improves your data quality.
May 8, 2023
Ensemble CI
What Is dbt And Why Is It Such A Game Changer For Data Teams?
How dbt is a simple yet transformative tool for data teams.
May 5, 2023
Ensemble CI
How dbt Helps Data Engineers Work Like Software Engineers
How dbt helps Data Engineers adopt practices that have traditionally been used by Software Engineers
May 1, 2023
Ensemble CI
Introducing Ensemble CI, A Continuous Delivery Platform For Data Engineers
Introducing Ensemble, a CI/CD platform built specifically for Data Engineers who use dbt.
Nov 17, 2022
General
Introduction To AWS Kinesis
Amazon Kinesis is a cloud-based service from AWS that's essential for real-time data streaming and analysis. Below are its key components:…
Nov 1, 2022
Streaming
From Historical Dashboards To Automated Interventions
Historically, business intelligence initiatives have focussed on providing self service dashboards and reports which are used to surface…
Oct 19, 2022
Tools
What Is Dash, And How Can It Benefit Your Business?
As we know, many business intelligence are overly focussed on dashboards as the means of disseminating information, and we believe this is…
Oct 19, 2022
General
Why Embedded Analytics Beat Dashboards & Reports
Most Business Intelligence or analytics projects today aim to deliver reports and dashboards as the eventual output. The idea is that…
Oct 19, 2022
Tools
Why You Need An Orchestrator In Your Data Stack
Data Orchestration platforms such as Airflow, Dagster and Prefect can be used to execute and co-ordinate all of the data related pipelines…
Oct 19, 2022
General
The Risks Of Consumption Based Pricing For Analytics Tools
Broadly, there are three ways to price any subscription software product: Consumption Based - where the price charged is based entirely on…
Oct 19, 2022
Streaming
Real Time Data and Analytics
The vast majority of Business Intelligence and Analytics solutions in place today operate on out-of-date, backwards looking, historical data…
Oct 19, 2022
Streaming
Real Time Closed Loop Analytics
Many companies today are interested in using data to improve their business and customer experience. Most of these initiatives ultimately…
Oct 19, 2022
General
Why OpenTelemetry Has The Potential To Simplify IT Operations
Telemetry is about collecting information from remote sources and bringing it back into a centralised location for analysis and monitoring…
Oct 19, 2022
Data Strategy
Rise Of The Citizen Data Scientist
Enabling Business Users To Carry Out Their Own Data Science and Analytics
Sep 3, 2022
Databricks
Databricks Structured Streaming Example
Databricks structured streaming is the modern way to work with streaming data in Spark.
Sep 3, 2022
Streaming
Materialised Views On Event Streams
Imagine we have a stream of events representing new orders: Much of the move to event driven architecture is about responding to these…
Sep 3, 2022
Streaming
Using Real Time Data To Guide Employee Next Best Action
There has been a long held concern as to whether “Artificial Intelligence” will ultimately, replace humans en masse in the workforce. For…
Sep 3, 2022
Streaming
Why Event Driven Architecture and Streaming Data Improves Audit & Compliance
Imagine we have a database table of customer details which sits behind a typical web application: Name Address Gender Lifetime Spend Ben…
Sep 3, 2022
General
Big Datas Elephant In The Room
For many years, "Big Data" was a major buzzword in enterprise IT. The theory was that as data volumes grew, we would need different…
Sep 3, 2022
Streaming
How Moving From Batch To Real Time Data Integration Improves The Customer Experience
Over time, the typical business acquires more and more applications. Some will be bespoke, some off the shelf, some cloud hosted SaaS tools…
Sep 3, 2022
General
Is Your Procurement Department Throttling Your Ability To Innovate?
Big Corp Enterprise LTD are in the business of making widgets. They are a huge business and have led their industry for decades. However…
Sep 3, 2022
Streaming
Moving From Batch To Streaming Extract, Transform and Load
There are many situations in Enterprise IT where we need to move, copy or integrate datasets. For example, populating a centralised data…
Sep 3, 2022
Tools
Why Serverless Is The Future For Data & Analytics Platforms
In the bad old days, the first step when building a database, analytics or business intelligence solution would be to order or provision a…
Sep 1, 2022
Streaming
Moving Towards Real Time Data & Analytics
As your business operates day to day, a number of events are taking place. Examples include orders, dispatches, customer enquiries or…
Feb 3, 2022
General
From Titanic Releases To 10,000 Speedboats With Continuous Delivery
Does your software release process look anything like this.... Releases are big events marked months ahead on the calendar; A lot of…
Feb 1, 2022
General
Step Away From The Dashboard
The humble dashboard is limiting the potential of what businesses achieve with data and analytics. The idea of a dashboard always sounds…
Jan 4, 2022
General
Three Areas Of Opportunity With Data and Analytics
Data and analytics are crucial for businesses who are looking to make better decisions, operate more efficiently and build great employee…
Jan 2, 2022
Streaming
In Business, Everything Is An Event
Imagine a simple customer interaction for an eCommerce business: A customer visits the website and browses various products; A few days…
Jan 2, 2022
General
From Strategic To Operational Analytics
Historically, businesses have used their data and analytics over strategic time horizons. For instance, collecting information about what…
Jan 1, 2022
General
Our Approach and Partnership Model
Ensemble are a new professional and managed services firm who help companies build sophisticated real-time data and analytics solutions…
Jan 1, 2022
General
Why We Launched Ensemble
Data and analytics are a huge enabler for businesses who are looking to make better decisions, operate more efficiently and build great…
Nov 13, 2021
General
Integrating AWS Bedrock and MongoDB - Part 2 - Agents
Introduction In these articles we aim to demonstrate two different ways for integrating Bedrock with MongoDB Atlas, the cloud hosted version…
Nov 8, 2021
General
Don't Outsource Your Thinking To AI
As an AI consultancy, we are of course bullish on the use of AI in business. We think it can automate tedious work, help businesses make…
Apr 6, 2020
General
Analysing FIX Logs With ClickHouse
ClickHouse is gaining more and more market share in the capital markets industries. It's combination of high speed. We have previously…
Apr 6, 2020
General
FinCrime Draft - From Rule Based To Behavioural Analysis
Traditionally, financial institutions use rule based systems to monitor for situations which could be indicative of a financial crime or…
Apr 6, 2020
General
FinCrime Draft - How Is The Nature Of Financial Crime Changing
Those wanting to commit serious financial crime or violate sanctions programs will continue to use methods we are all familiar with. For…