How I work with data?

It was 6 pm on a Monday. And it was my first time working with a big dataset.

Just a couple of moments into my sojourn, I felt submerged under the weight of what to do? where to do start? and how to proceed?

I soon realised I needed a framework to tame the dataset and to sail smoothly through my sojourn.

It was then that I developed a three-step framework to guide me on my journey.

In this very first InkStains' post, I thought I would share this framework with you with the intention that it powers you as much it powered me.

The three steps I follow are:

• start with a sketch,

• log intermittent insights, and

• close with a coda.
  

Start with a sketch:

Before I begin working with any data, I write down the start point, the endpoint, and the possible routes I can take.

Specifically, I answer these questions:

1. Where am I starting from? What is it I know? What is it I don’t know?

2. Where do I want to reach? Which is the specific graph or result I envision at the end of my journey?

3. Which 3-5 broad steps I can take to reach from the start to the end point?

Log intermittent insights:

On my journey, I log my steps to trace them when I need to. It also allows me to be aware of my process and to stay attuned to the envisioned end point.

Another thing I collect on my journey are the unexpected gems: an insight, an epiphany, or a connection between the data points.

Close with a coda:

As I near the end of my day's journey, I enjoy some mellow and monotone moments of calm after the exhilarating experience.

I sit down to give a quick clean to the code files and pen down my closing thoughts. These closing thoughts are generally along the lines of how far I came and which steps are up next.

Through experiences I have had, I find it encouraging to know that I was able to hit an intermediate target even though I didn’t manage to reach the envisioned target today.

When I made the framework for myself, I knew it was beneficial, but it took me a couple of weeks to embody it. Once I did, it made my process enjoyable and empowering.

P.S.: Be gentle with yourself. You don't have to follow every step every time. Allow yourself to find your own groove. - Vasundhara