Coder Social home page Coder Social logo

infrastructure's Introduction

NumFOCUS Infrastructure Committee

This repository contains information regarding the NumFOCUS infrastructure.

Main sections:

  • Review Process: Information regarding the process for projects to ask for infrastructure and what to expect from the review process
  • Projects: Information regarding NumFOCUS projects that use shared infrastructure
  • Vendors: Information about NumFOCUS infrastructure providers (e.g., hosting companies)

Contact

To contact the committee, you can use the email address: [email protected]

infrastructure's People

Contributors

arliss-nf avatar aterrel avatar bryevdv avatar datapythonista avatar dependabot[bot] avatar mriduls avatar nabobalis avatar vfdev-5 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

infrastructure's Issues

Application for AWS Credits for Projects

Project

All Sponsored Projects

Observations

I've been working with the program manager for the AWS Free and Open Source Software Fund and we have been selected to apply for credits on behalf of projects. To apply we must complete this application.

We are not guaranteed to be awarded all credits requested, but there is high likelihood that we will receive a majority of our asks. Additionally, we can ask that our credits be awarded for two years instead of one so there isn't as much burden of reapplying. AWS is also working on codifying the parameters of the program so that we will have a much clearer understanding of the reapplication process going forward.

To complete the application we will need to include specific asks for each project as well as any blanket requests that could benefit multiple projects. Reaching out to each project individually can be a lengthy process and since not all projects need this support, it may not be very efficient. In the past, we have put out a mass call to projects but did not receive many responses.

NumFOCUS staff is happy to coordinate gathering the information for the application but we will need the committee's help to ensure that the technical aspects of the application are completed appropriately. It would also be helpful to us if you all could work with us on gathering the asks. What might be a good approach to getting asks from projects? Are there specific projects that we could focus on or asks that have been made to the committee in the past that could benefit from this support? Are there any blanket needs for multiple projects we could include?

I intended to add this as an item at the next meeting, but since it had to be postponed I thought I would bring it up here so we could get the ball rolling asynchronously.

Switch off servers that are not in use

Some servers doesn't seem to be in use anymore. We should double check this is the case, and then cancel them. So far, looks like those are the candidates (listing rackspace service names):

  • amy NumFOCUS internal tool for workshops not in use anymore, as confirmed by Andy
  • bokeh (confirmed by Bryan this is not being used)
  • scipy-mail and mail2.scipy.org (acoording to this scipy wiki this is not being used since 2018. Didrik doesn't know about those servers)
  • researchcompendia.org (repos of the site haven't been updated since 2014, I guess it's save to assume this can be switched off)
  • pydata-org (old PyData site based in Django: https://github.com/pydata/pydata.org. there shouldn't be anything useful here)
  • dask2021, eindhoven2021, global2021 and jupytercon2020 once #12 is completed
  • pydata.org-2 once #15 is completed
  • berlin.pydata.org once #16 is completed

Move routing from pydata.org-2 to cloudflare and a AWS worker

The rackspace instance pydata.org-2 used to host a deprecated version of pydata.org, and not it's only used to route traffic of pydata.org sites to other instances via nginx. We can move this routing to cloudflare and an AWS worker hosting pydata.org sites, and we should be able to switch off the server.

Get the content of berlin.pydata.org

PyData Berlin is going to move their website to GitHub pages. But looks like the person who set it up (Matti) is not active in the community anymore, and Adrin, who is taking care of it now, doesn't have access to the server, and doesn't have a copy of the website.

It'd be great if we can get a zip with the content of the website (and the source code in Jekyll, if it happens to be in the server), so they can set it up in GItHub pages, and we can switch off the server.

Bug: Navigation Menu Highlighting Issue in Numfocus Website - Project Dropdown Highlights Programs Dropdown

In the Numfocus website's navigation menu, there is a highlighting issue where clicking on the "Project" dropdown not only activates the corresponding dropdown but also unintentionally highlights the "Programs" dropdown. This behavior can cause confusion and impacts the expected navigation flow.

Steps to Reproduce:

Visit the Numfocus website.
Navigate to the navigation menu.
Hover over the "Project" dropdown.
Observe that both the "Project" and "Programs" dropdowns are highlighted.
Expected Result:
Clicking on the "Project" dropdown should only activate and highlight the "Project" dropdown, not affect the highlighting of other dropdowns.

Actual Result:
Clicking on the "Project" dropdown also highlights the "Programs" dropdown, leading to an unintended visual interaction.

Get.Involved.with.the.NumFOCUS.Community.-.NumFOCUS.-.Google.Chrome.2023-12-18.21-32-43.mp4

Restore conferences.scipy.org

I think we disabled the site conferences.scipy.org, but this is used for the SciPy conference, and should be restored. I spoke with Didrik, and would be great to have it back soon, as the conference is in 4 months.

Enable cost-explorer

As reported by @bryevdv, bokeh received this message.

Your account is a part of consolidated billing. For you to be able to use Cost Explorer, your Payer account needs to enable Cost Explorer.

Investigate and report how to proceed here.

scverse certiicates

Project

scverse

Observations

See comments from ivirshup at: #34 (comment)

Looks like the github certificate expired and switching to ssl termination broke muon.scverse.com. Need to debug options.

credits for CI

Project

MDAnalysis

Observations

We are seeking funds to cover some of our recent losses in free CI provisions (i.e., Cirrus CI, to check against "exotic" architectures) and to obtain access to high core count GitHub actions machines. The latter would support work done by one of our recent Google Summer of Code students on enabling the large scale parallelism of the MDAnalysis library on HPC platforms.

TOTAL $970.00 : CI costs for a one year period, broken down as follows:

  • $600.00: Cirrus CI tokens

    We use 50-100 Cirrus CI tokens per month, 50 of which will be free moving forward. 50 extra tokens ($50) per month would allow us to retain CI services.

  • $370.00: GitHub Actions

    We can access GitHub large runners (as a CI service to accommodate multithreaded work) for $0.256 per minute (64 cores, Linux). We estimate needing approximately 2 hours of CI per month.

Write access to this repo

It'd be great if I can get write access to this repo. For now I need it to create labels, but would be good to be able to merge PRs and others in the future.

Cirrus CI credits across projects

Project

NumPy, SciPy

Observations

Quite a few projects use Cirrus CI, as it is a well-designed service and still the only one to offer macOS arm64 (M1) support (as well as FreeBSD, which we use in NumPy as well). I'll xref gh-20, where Cirrus CI is the majority of the MDAnalysis request.

The problem with paying for credits is not the hundreds of dollars per year (maybe up to $1,000) for our projects. It's much more the logistics of buying credits for each project, getting reimbursed, etc. If a centrally negotiated/purchased request for a set of, or all of the, NumFOCUS projects could make that a lot easier, then I'm sure maintainers would appreciate that.

Remove BryanV from RackSpace

@bryevdv received the following notice. Bokeh hasn't been using Rackspace for a while and would like to be removed.

Notification
Rackspace Account #:    891151
Account Name:   James Powell
Service:    CLOUD HOSTING
Dear Customer,
Thank you for being a valued Rackspace Technology customer.
Starting on Tuesday, March 26, 2024, Rackspace mandates multi-factor authentication (MFA) for all customers that access MyCloud (login.rackspace.com) portal. From this date, you must use a secondary authentication method to access your Rackspace portal account.
If you have already MFA set up for your account, there is no need to take action from your end and you may skip the rest of this correspondence if you prefer to.
As you know, aggressive cyber-attacks on businesses, governments and nonprofits from both individuals and state-sponsored hacker collectives continue to evolve. One of the easiest ways you can protect yourself is to enable our free multifactor authentication (MFA) tool on your account.
Importantly, MFA is highly effective in guarding access to your account. Failing to enable MFA on your account leaves your account open to attack from bad actors around the world. Prevent data theft, infrastructure destruction and high bills from these bad actors by taking a few minutes to enable MFA.
To enable MFA on My Cloud, please follow the instructions in this link: https://docs.rackspace.com/docs/cloud-article-for-configuring-multi-factor-authentication
If you are using API integrations to Rackspace Cloud APIs, you will need to ensure that your integration will continue to function after this work is completed.
If your application authenticates using an API key today, then it won’t be affected. If it authenticates using username and password credentials, then the easiest solution is to switch to API key authentication, which you can view and reset by following instructions in this link: https://docs.rackspace.com/docs/view-and-reset-your-api-key.
Alternatively, you can implement MFA authentication within your code, as explained here: https://docs.rackspace.com/docs/multi-factor-authentication
Please take a moment to enable MFA on your account and ensure your data and infrastructure remain safe.
If you have any questions, please reach out to your support team at Rackspace.
Note: You do not have to take any action if you have already set up MFA for your account.
Sincerely,
Rackspace Technology
REF: CHG0150772

Cloudflare changes with Let's Encrypt

Email to Bryan V (Bokeh) from Cloudflare

We are reaching out to inform you about an upcoming change that will impact the device compatibility of Let’s Encrypt certificates issued after May 15th, 2024. We are reaching out to you because we identified that you are currently using Let’s Encrypt certificates through Universal SSL, Advanced Certificate Manager, Custom Certificates, or SSL for SaaS. We recommend that you familiarize yourself with the Let’s Encrypt change and make any necessary adjustments ahead of time.
I don't really know what to do with this information (or if it actually affects the bokeh.org domain, or if it just emailed me because I am on the NF CF account in general) is there someone I can forward this to? (edited)

Need to investigate and see if there is any impact to our users.

Checkbox Selection Triggers Page Refresh and Resets Scroll Position

When attempting to check a checkbox on the NumFOCUS website, the action triggers an unexpected page refresh, leading to an inconvenience as the scroll position resets to the top of the page. This behavior prevents users from efficiently selecting multiple checkboxes in one session.
This issue is reproducible on chrome browser and try to check the boxes in project menu.

Screen Recording of the bug

bug.mp4

Bug: Open Source Sustainability - "Learn More" link leads to 404 Page

Description:
Issue:
Clicking on the "Learn More" link under Open Source Sustainability on the NumFOCUS website leads to a 404 Page. The page is empty, and the message "No Results Found" is displayed.

Steps to Reproduce:

Visit the NumFOCUS website.
Navigate to the "Open Source Sustainability" section.
Click on the "Learn More" link.
Expected Result:
The "Learn More" link should lead to the relevant content on Open Source Sustainability.

Actual Result:
The link results in a 404 Page with the message "No Results Found."

This issue impacts the accessibility of information related to Open Source Sustainability, and I believe addressing it would improve the user experience on the NumFOCUS website.

bug2.mp4

CloudFlare account management concerns/suggestions

Cloudflare allows only Super Administrators to edit/manage account members. The numfocus account currently only has one Super Admin.

Expanding the number of Super Administrators on the account and deprecating the use of the current Super Admin account would streamline membership management. Right now, the current Super Admin account is a single point of failure (if NumFOCUS somehow loses access to that account, it might require us to switch to a new Cloudflare account and reconfigure everything). In addition, because that account is not tied to a specific person, there is less accountability when changes are made.

@bryevdv previously raised the concern that almost all of the members on the CloudFlare account are Administrators (who can access and change everything on the account except for billing and membership management) and do not have two factor authentication enabled. It would be best to require two factor authentication for all Administrators and restrict most members to the one or two domains that they might actually need to manage.

Build guide for CI/CD

Project

all

Observations

After speaking with @rgommers and @orbeckst, it was clear that having a guide to help projects navigate setting up CI/CD and paying for it with their NF funds is a good idea. Creating this ticket to track that work.

pandata.pydata.org

project

Pandata

Update existing subdomain?

  • This request is for updating the DNS of an EXISTING subdomain

Subdomain

pandata

DNS

I'm not sure what DNS records would be involved, but we were hoping that pandata.pydata.org could point to https://github.com/panstacks/pandata for now until we get a proper website set up.

Observations

I run the NumFocus fiscally sponsored project "HoloViz". We've recently realized that we need a name to talk about a much larger set of projects of which HoloViz is a part, and so we've created Pandata as a concept. Pandata is mostly a subset of the PyData ecosystem, focusing on tools for data analysis that scale to very large data sizes. I'd like to set up a steering council for Pandata and get people on board to handle governance, but in the meantime to get it off the ground we just need some sort of web presence to point people to. So if pandata.pydata.org would go somewhere that talks about it, we can get the process started to get the rest of these things in place. Hope that works!

ASV benchmarks for MDAnalysis

MDAnalysis has been running ASV benchmarks for the last 6 years and published them at https://www.mdanalysis.org/benchmarks/ . Data are held in https://github.com/MDAnalysis/benchmarks . These benchmarks have been running on a local machine. We would like to run the set of benchmarks on NumFOCUS infrastructure.

Key considerations for us

  • long term stability
  • access to the benchmark runner for multiple Core Developers (i.e., ability to start runs after configuration changes for debugging)

We would also like to upload historical data for comparison https://github.com/MDAnalysis/benchmarks. This would be a one-time process.

cc: @MDAnalysis/coredevs

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.