Objective : The aim of this post is to create a scheduled job that can run on big data from the Chembl database on a nightly basis and generate useful reports and graphs that can be used by researchers for further detailed analysis and discovery of new drugs. Architecture : This job is based uponContinue reading “ML based Scalable Bioinformatics cronjob for Computational Drug Discovery”
Tag Archives: python
Detecting the onset of covid-19 early using heartrate measurements collected from wearable devices
Through this blog post I shall be creating a solution architecture for the following Collecting wearable devices data from multiple users. For example heartrate from Fitbit and Apple HealthKit devices. Ingesting this data into an influxdb database running inside a docker container Running a pyspark job on aws EMR cluster to calculate heart rate variability,Continue reading “Detecting the onset of covid-19 early using heartrate measurements collected from wearable devices”
Python based framework for FOTA (Firmware Over The Air)
A very common requirement in IoT based systems is to remotely install updated versions of firmware on devices. Presented in this blog is a python based generic framework for performing the update. Salient features : Meager code footprint of less than 4 KB. Secure download from s3 bucket using access key and secret. Secure deviceContinue reading “Python based framework for FOTA (Firmware Over The Air)”
Load testing Python Flask based REST api server from python REST clients – AWS Autoscaling use case
Objective : Create a get, put and post api using python based flask framework Invoke the api using a python based rest client Set up an AWS load balancer in front of the server Launch a swarm of 1000+ clients to invoke the rest api from a python client using aws EC2 Auto Scaling featureContinue reading “Load testing Python Flask based REST api server from python REST clients – AWS Autoscaling use case”
Two ways to talk to Azure IoT Hub
This article lists down 2 ways to communicate with Azure IoT hub : An insecure method using a standalone java client A secure certificates based method using a standalone python client Most of these instructions can be found on the Azure site but is scattered all over the place. This code has been been runContinue reading “Two ways to talk to Azure IoT Hub”
Steps to setup an Opensource Real-time IoT data pipeline in Azure cloud
Architecture diagram: Through this and a subsequent series of articles I would like to layout a detailed step-by-step process for building a realtime IoT data pipeline based primarily on Apache open source technologies on Azure cloud. I start with the detailed architecture and instructions to build production grade clusters. In the subsequent article we shallContinue reading “Steps to setup an Opensource Real-time IoT data pipeline in Azure cloud”
Raghu Tirnellai's blog 