Using Apache Nifi to capture COVID-19 data
I have a confession to make. OK, not really anything that is not already publicly known: I am a huge nerd. I love tech, and especially software. I love learning about it and sharing my knowledge with as many people as I can.
When I joined Reprise as a member of the sales team, my only fear was to lose this opportunity for tech exploration that drove so much of my career so far.
After 15 seconds of introspection, I remembered why I joined Reprise in the first place: we enable tech evangelization.
Armed with these 15 seconds of thorough soul searching, I decided to use our platform to do what I love most: play with tech and share it with people.
So without further ado, let me introduce you to: Paul’s Tutorial Series!
Chapter 1: Nifi
What is it? Every week, I chose a piece of tech that picked my interest, and create an easy to consume tutorial showcasing this tech.
Why do I do it? I’m a
huge nerd passionate about tech.
Who is this for? Anyone really. The goal is tech evangelization, without ulterior motive, just love.
What’s the topic for this week? This week, I couldn’t resist but to showcase one of my favorite Apache project: Apache Nifi. Nifi has always been my favorite because of its simplicity and scalability. Look, who does not need to move data around? No one that’s who.
Specifically, I designed a simple 3 steps tutorial in which you will learn to call an API, convert a JSON payload to CSV and store it on disk.
The API we will call can be found in RapidAPI, here. Enjoy!
See the replay of this configuration by clicking on the image below:
Obviously, this is a very simple flow. Don’t let the simplicity fool you though, the possibilities are endless with Apache Nifi.
I’ve seen many large organizations build end to end data pipelines, interfacing with many data feeds and storage options.
Image by: Roman Spiridonov