Code refactoring about gcp_scanner

[mshudrak]

@Roshan102003 we do not assign bugs for individuals now since we have a lot of interest from various contributors. So far, we had multiple PRs to fix this issue. However, this is a long term project requiring coordination with project owners and design doc. I'd prefer to keep it for GSoC 2023 timeframe.

[mshudrak]

Yes, we will consider applications for this issue. It is one of projects listed for GSoC 2023. There is some progress but it requires much more refactoring.

[sudiptob2]

I can take this issue and do the initial refactoring of the crawler. I have experience in python best practices and the styling guide of flake8, pep8 etc. Besides I have been writing python in production for about 2 years now.

Nevertheless, I can always do the necessary research if required and take suggestions from other community members.

[ggold7046]

Hi @sudiptob2 , @mshudrak , I have basic python knowledge; could I join in this work ? I need guidance though.

[mshudrak]

Feel free to join :)

[RahulDubey391]

@mshudrak @ZetaTwo @sudiptob2 Hi, I'll help in creating class designs for code refactoring as well as object pickability for parallelization. Will create an initial PR for review and considerations. Thanks!!!

[ggold7046]

Hi, Is this work still going on ?

[aryanagrawal22]

Hi. I am writing to inquire about the status of this issue that I am interested in contributing to as a part of the Google Summer of Code program 2023. Specifically, I am wondering if the issue is still active and if any proposals for it will be considered as I can already see some progress.

[ggold7046]

Hi @mshudrak , could you guide about the files where the codes needs to be refactored ; and is there any special suggestions ?

[mshudrak]

Basically, we want to refactor most of the code in the project. I don't have any special suggestions. You may choose your own refactor strategy in the proposal.

[sudiptob2]

I have suggested a refactoring strategy in my proposal. If I get selected for GSOC I guess I will be able improve the project's scalability 🙂

[ggold7046]

Basically, we want to refactor most of the code in the project. I don't have any special suggestions. You may choose your own refactor strategy in the proposal.

Thanks @mshudrak for your reply. Could you tell me any file which will be easier for me to start to refactor ? As there are lots of files.

[Roshan102003]

@mshudrak Can you assign this to me, I can do it in no time?