Skip to main content

3 posts tagged with "ai"

View All Tags

Unsupervised anomaly detection with Anomalib in Python

· 10 min read
Anthony Cavin
Co-founder & CEO - Data, ML & Robotics Systems

Anomaly detection pipeline: a camera feeds Anomalib, which scores each frame, and ReductStore keeps every frame with its anomaly labels

Anomalib makes it relatively easy to train an anomaly detection model on your own images. But once you want to use it in production, you also need to handle inference, evaluate predictions, and keep track of the images that triggered them.

In this tutorial, we'll use anomalib to train and run an anomaly detection model in Python. Then we'll look at how to store images alongside their anomaly scores, so you can review detections and use them for future training.

Implementing Data Streaming in PyTorch from Remote DB

· 9 min read
Anthony Cavin
Co-founder & CEO - Data, ML & Robotics Systems

When training a model, we aim to process data in batches, shuffle data at each epoch to avoid over fitting, and leverage Python's multiprocessing for data fetching through multiple workers.

The reason that we want to use multiple workers is that GPUs are capable of handling large amounts of data concurrently; however, the bottleneck often lies in the time-consuming task of loading this data into the system.

Moreover, the challenge is even trickier when there is simply too much data to store the whole dataset on disk and we need to stream data from a remote database such as ReductStore.

In this blog post, we will go through a full example and setup a data stream to PyTorch from a playground dataset on a remote database.

Let's dig in!

Open-Source Alternatives to Landing AI

· 8 min read
Anthony Cavin
Co-founder & CEO - Data, ML & Robotics Systems

Photo by Luke Southern

Photo by Luke Southern

In the thriving world of IoT, integrating MLOps for Edge AI is important for creating intelligent, autonomous devices that are not only efficient but also trustworthy and manageable.

MLOps—or Machine Learning Operations—is a multidisciplinary field that mixes machine learning, data engineering, and DevOps to streamline the lifecycle of AI models.

In this field, important factors to consider are:

  • explainability, ensuring that decisions made by AI are interpretable by humans;
  • orchestration, which involves managing the various components of machine learning in production–at scale; and
  • reproducibility, guaranteeing consistent results across different environments or experiments.