GSoC Week 11

 This week can be characterized as "Struggle and Progress"


I worked on two major things this week,

- Integrated the ever so complex kaggle RSNA mammography top performing model

- Codebase deep dive and coding for React OHIF hook implementation


Kaggle RSNA Mammography Model Integration

After going through the codebase multiple times and fixing the inference code on my local everything was working fine except for the part where the image is cropped using a YOLO model or an Otsu thresholding method before being passed to the final classification ConvNext Model.

The issues I faced were,

The models were tuned for specific GPUs to run much faster but for the LH application we would need to run on CPU or GPU based on their availability. So I needed to use the unoptimized models and figure out a few other complexities surrounding them such as modifying a chunk of codebase, identifying the right model to initialize, etc

There were a lot of dependency issues for the YOLO model which I had to figure out. More than codebase related errors, dependency errors took a chunk of my time. I was reminded of the statement "it works on my system". Changes were made to the Docker file and to the codebase to accommodate dependency issues.

Finally after resolving all these, resolving dependency issues, passing test cases the new AI model still wouldn't run. After a lot of head scratching I figured out the docker containers running on my local were failing because the model size was larger than usual and there was not enough memory so it just exited without throwing any errors making it difficult to debug.


React OHIF hook implementation

I did a lot of code deep dive to understand how to proceed with implementation. I started with adding a button to the OHIF toolbar but it never showed up in the application. I made multiple changes but still no luck. This is one of the initial parts I'm trying to figure out.

After that I will need to connect the implemented buttons to the controllers and from there to the backend AI Model Service calls from the Java app.


I will need to push harder and harder this week to get a lot of stuff done! Hoping for the best!

Comments

Post a Comment

Popular posts from this blog

Google Summer of Code 2023: AI Model Service Auto Selection by Modality - Final Report

Image
Introduction GSoC is one amazing program that lets students and professionals get into the world of open source, contribute code and also learn back from the program. I definitely learnt a lot by contributing to my mentoring organization LibreHealth through GSoC'23. I now understand the value of open source and will become a lifelong contributor wherever and whenever I can. LibreHealth is an umbrella organization where multiple health information technology projects collaborate. I was actively involved in contributing code to their LibreHealth Radiology application  through the project "AI Model Service Auto Selection by Modality". My contributions to the application were more involved into implementing AI models in the application and also building modules that do automatic model selection, example, when a Radiologist opens up a Mammography image the application automatically triggers the Mammography AI model to produce inferences on the image. Objectives The project des
Read more

My First GSoC - LibreHealth Community Bonding Period

GSoC Acceptance I was amazed to know that I got accepted into Google Summer of Code 2023. This is my first time applying and getting into GSoC. I remember the time when I sat at the library for hours, working on the preliminary tasks, figuring out solutions, and writing an extensive proposal. Reiterating through the solution and proposal back and forth, I watched lots of YouTube videos and read blogs providing tips to draft a good proposal. All the efforts paid off when I received the email of acceptance. The Org & Project I drafted a proposal to the LibreHealth Organization. LibreHealth is collaborative community for free & open source software projects in Health IT, and is a member project of Software Freedom Conservancy. It is amazing to just think about how contributors from all over the world come together and build things that impact the world positively. This idea is what brought me into open source. Before jumping into the project details, here are a few things about m
Read more

GSoC Week 2

Image
By the end of last week, I was able to meet my mentor, which helped me gain direction for the project. We discussed details and challenges regarding the implementation of the AI model selection based on image modality. Although Java is a new language to me, I wanted to learn and work my way through it for the project. This week, my task was to understand parts of the LibreHealth toolkit code and prepare a list of tasks at an atomic level. After that, I will need to update them to the GitLab issues list. Coming up with the task list To come up with the task list, during the meeting with my mentor, I received some guidance on where to start with code exploration and understanding. Initially, it was challenging for me to understand the code, so I started looking at Java tutorials on YouTube. I gained some understanding of how Java works. However, I knew this was not enough for me to completely understand the application, and it would take time, so I also started looking for patterns in th
Read more