GSoC Week 2

By the end of last week, I was able to meet my mentor, which helped me gain direction for the project. We discussed details and challenges regarding the implementation of the AI model selection based on image modality. Although Java is a new language to me, I wanted to learn and work my way through it for the project.

This week, my task was to understand parts of the LibreHealth toolkit code and prepare a list of tasks at an atomic level. After that, I will need to update them to the GitLab issues list.

Coming up with the task list

To come up with the task list, during the meeting with my mentor, I received some guidance on where to start with code exploration and understanding. Initially, it was challenging for me to understand the code, so I started looking at Java tutorials on YouTube. I gained some understanding of how Java works. However, I knew this was not enough for me to completely understand the application, and it would take time, so I also started looking for patterns in the code.

Changes to LibreHealth Toolkit,

To implement the AI model selection based on imaging modality, I was able to trace the code that led me to two .java files and the config.xml file where I will need to create code that adds parameters to the administrative settings view. The parameters would mainly include the model's modality, task, and API. Next, I will need to modify the Model task list to a dropdown. The dropdown will have values filled by making a call and fetching information from the '/models' API from the AI model service. I traced back to figure out the implementation of the API and landed on this page. After that, I will need to understand how to call the function once the administration page is opened.

Once these steps are done, I will need to modify the existing calls to the AI model service to use the newly implemented parameters. I was able to identify the code that needs modification.

Changes to AI Model Service,

Regarding the changes to the AI Model Service, based on the changes that will be performed on the LibreHealth Toolkit, the AI model service bounding-box API method needs to be changed to accept dynamic inputs. Based on the input modality, model, and task, we will need to route to the appropriate model. One way to achieve this would be to build a function that takes in the inputs and uses a dictionary to map the parameters to the AI model to be called.


Coding it

After figuring out the requirements for the tasks discussed above, I started coding for the administrative view changes. I installed the necessary requirements but faced some issues. I ended up rebuilding the Docker images and was able to see the desired changes in the administrative view. However, I still need to make changes to the layout and also get feedback from my mentor this week. After that, I will code for the other tasks.



Travel Partial Blocker for GSoC Week 3 

During GSoC Week 3, I will be traveling to Slovenia for a conference (AIME 2023) where I will be presenting a demo paper. I am excited about it. However, this doesn't mean that it will completely block me from working on GSoC. It just means that I may have less time available to contribute to the project.

Comments

Post a Comment

Popular posts from this blog

Google Summer of Code 2023: AI Model Service Auto Selection by Modality - Final Report

Image
Introduction GSoC is one amazing program that lets students and professionals get into the world of open source, contribute code and also learn back from the program. I definitely learnt a lot by contributing to my mentoring organization LibreHealth through GSoC'23. I now understand the value of open source and will become a lifelong contributor wherever and whenever I can. LibreHealth is an umbrella organization where multiple health information technology projects collaborate. I was actively involved in contributing code to their LibreHealth Radiology application  through the project "AI Model Service Auto Selection by Modality". My contributions to the application were more involved into implementing AI models in the application and also building modules that do automatic model selection, example, when a Radiologist opens up a Mammography image the application automatically triggers the Mammography AI model to produce inferences on the image. Objectives The project des
Read more

GSoC Week 1

This week I was researching AI models to implement for the different modalities. More specifically, Mammography. I also finally had the opportunity to talk to my mentor on Thursday (June 1st, 2023). You can find the recorded meeting link  here . Building a Breast Cancer Classification Model from Scratch At the start of the week, I attempted to implement a VGG16 classifier to distinguish between malignant and benign calcifications in a mammogram. Using PyTorch, I developed the model and achieved a validation accuracy of approximately 70%. The source code can be accessed  here . This model and code serve as a starting point for implementing a more complex model mentioned in this  paper . Briefly, the paper discusses building a model solely on the region of interest (ROI) of the calcification/tumor and adding layers and training on the entire images. This method has significantly reduced the training loss and, consequently, improved overall accuracy. Mentor Discussion and Change in Direct
Read more

My First GSoC - LibreHealth Community Bonding Period

GSoC Acceptance I was amazed to know that I got accepted into Google Summer of Code 2023. This is my first time applying and getting into GSoC. I remember the time when I sat at the library for hours, working on the preliminary tasks, figuring out solutions, and writing an extensive proposal. Reiterating through the solution and proposal back and forth, I watched lots of YouTube videos and read blogs providing tips to draft a good proposal. All the efforts paid off when I received the email of acceptance. The Org & Project I drafted a proposal to the LibreHealth Organization. LibreHealth is collaborative community for free & open source software projects in Health IT, and is a member project of Software Freedom Conservancy. It is amazing to just think about how contributors from all over the world come together and build things that impact the world positively. This idea is what brought me into open source. Before jumping into the project details, here are a few things about m
Read more