close
Page MenuHomePhabricator

Cloud-VPS (Project-requests)Milestone
ActivePublic

Details

Description

Requests for creating or deleting Cloud-VPS projects. See openstack-browser for a list of existing projects and their members. For quota changes see Cloud-VPS (Quota-requests)

Before you request a project

  1. Confirm you cannot run your code/bot/thing on Toolforge. You can request access to Toolforge by following the instructions on wikitech. With Toolforge, the underlying infrastructure will be taken care of for you, and you can focus on writing your tool / bot / researchy-thing.
  1. Only request a VPS project if you need root on the VM for a specific purpose (or need testing VMs for MediaWiki changes, etc). Remember that if you have root you have responsibilities too! :)

Maintainer responsibilities

Each Cloud VPS project must have one or more active maintainers. Maintainers must have an active Phabricator account, must subscribe to the cloud-announce mailing list, and must respond to tasks, emails, and requests for action on the part of WMCS staff and admins.

In addition, maintainers of VMs in Cloud VPS projects must provide basic maintenance on their servers: puppet needs to be kept in working order, upgrades will need to be applied periodically, and VMs will need to be periodically deleted and recreated with updated OS images.

If a project is not actively maintained, or WMCS staff are unable to contact maintainers for a long period of time, that project will be shut down and ultimately deleted along with all associated configuration and data.

Project scope

Cloud VPS projects should be scoped based around concrete products or software projects, rather than the team working on them. The three main problems that we (the Cloud Services team) have seen in the past with team ownership/scope for Cloud VPS projects are:

  • Team gets disbanded/reorganized but its project needs to live on due to hosting of important VMs
  • Difficulty establishing who is the primary point of contact for a given VM when trying to reclaim quota or fix a broken instance
  • Tendency to close membership/participation to only team members rather than inviting participation by other volunteers

There are things that can be done to mitigate these problems, but the easiest thing to do is to create more targeted projects that are scoped to a product/project rather than a team. This can become a burden in other ways if a common group of developers is active on a large number of such projects, so we are willing to be flexible if good cause can be shown for project consolidation.

For more guidance, see https://wikitech.wikimedia.org/wiki/Help:Cloud_VPS_project

Requesting a new project

To request a new project, create a task using this link, and fill out the requested information by <replacing the instructions>

Note that there's currently some restrictions on the name of the project: it should not contain underscores or special characters, because it will be used in DNS records.

Process

Requests can be granted when approved by a quorum of at least two Cloud VPS administrators. If a decision is not made asynchronously, requests are processed by the cloud-services-team during the Cloud Services team meeting every Thursday (8:00 PST) that the meeting is held. This schedule may be effected by holidays, conferences, or other unavailability.

Once approved, creation of the project in OpenStack will be handled by a member of the Cloud VPS admin team. This will typically happen within 1-2 days, but may take longer due to availability of computing resources or higher priority administration tasks.

See also

Recent Activity

Wed, Aug 5

Raymond_Ndibe moved T433305: Request creation of pageviews VPS project from Inbox to Toolforge suggested on the Cloud-VPS (Project-requests) board.
Wed, Aug 5, 3:32 AM · Tool-Pageviews, Cloud-VPS (Project-requests)

Mon, Aug 3

Maintenance_bot removed a project from T433055: Request creation of PanoCommons VPS project: Patch-For-Review.
Mon, Aug 3, 11:33 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
dcaro closed T433055: Request creation of PanoCommons VPS project as Resolved.

If you have not yet subscribed, please subscribe to cloud-announce to receive maintenances, downtimes and notices when we need you to do something.

Mon, Aug 3, 10:43 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T433055: Request creation of PanoCommons VPS project.

projects: added project panocommons

Mon, Aug 3, 10:37 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
CodeReviewBot added a project to T433055: Request creation of PanoCommons VPS project: Patch-For-Review.

group_199_bot_f98be072172e323ae6d1441939d3e461 opened https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/341

Mon, Aug 3, 10:27 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
dcaro moved T433055: Request creation of PanoCommons VPS project from Backlog to In progress on the tools-platform-team board.
Mon, Aug 3, 10:25 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
dcaro added a project to T433055: Request creation of PanoCommons VPS project: User-dcaro.
Mon, Aug 3, 10:24 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
dcaro claimed T433055: Request creation of PanoCommons VPS project.
Mon, Aug 3, 10:24 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)

Thu, Jul 30

fnegri added a comment to T433055: Request creation of PanoCommons VPS project.

+1, sounds reasonable to me.

Thu, Jul 30, 3:11 PM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
MusikAnimal changed the status of T433305: Request creation of pageviews VPS project from In Progress to Stalled.

So, the pageviews-test Toolforge account already exists (pageviews has a bajillion incoming links; not good for testing), and I have the means to set up a new VPS instance on the commtech project (for testing). I will get the test VPS instance running as soon as time allows, and give an honest attempt at replicating the same on Toolforge. Toolforge may require the build service, or an increase in quota… I'm not sure. I'll report back when I know more.

Thu, Jul 30, 7:18 AM · Tool-Pageviews, Cloud-VPS (Project-requests)

Wed, Jul 29

bd808 added a comment to T433305: Request creation of pageviews VPS project.

Would it be possible that some day, we impose the API limitations on WMCS as well, and we'd need a floating IP to allowlist the Pageviews backend?

Wed, Jul 29, 8:44 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
Ottomata added a comment to T433305: Request creation of pageviews VPS project.

I am of course keen to respect Data Engineering's desires, as well as Cloud Services' recommendations.

FWIW, I am not strongly opinionated.

Wed, Jul 29, 7:18 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal added a comment to T433305: Request creation of pageviews VPS project.

Given the sysadmin docs on Wikitech, setting up a new VM from scratch should be fairly straightforward. In my experience, I spend a lot more time fixing things I maintain on Toolforge. But I am of course keen to respect Data Engineering's desires, as well as Cloud Services' recommendations. It just hasn't worked for me in the past. There is some file read operations in this tool, but not so much writing to files (apart from normal logging, which can be disabled). I'm also using APCu a lot more heavily in the new version, which should make things smoother.

Wed, Jul 29, 7:08 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
Ottomata added a comment to T433305: Request creation of pageviews VPS project.

Since DE will be owning this...if we could use toolforge I think we would prefer that over a VPS that we have to occasionally replace for debian upgrades ;)

Wed, Jul 29, 6:50 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
bd808 added a comment to T433305: Request creation of pageviews VPS project.

Every tool I've ever maintained eventually hits a breaking point on Toolforge if receives a lot of traffic. Such is the case with Pageviews.

Wed, Jul 29, 6:29 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
bd808 added a comment to T433305: Request creation of pageviews VPS project.

Are there any other relevant tools you might want to have a non commtech VPS project to migrate too? If so, we could think of some more generic name. Otherwise, whatever you like is fine with me.

Wed, Jul 29, 6:21 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal added a comment to T433305: Request creation of pageviews VPS project.

Not on my end. The other VPS instances on the commtech project are planned to be removed entirely. Popular Pages Bot (which runs on commtech-bot02.commtech.eqiad1.wikimedia.cloud) is the only other one that does anything currently – that one I plan to keep running until it dies naturally.

Wed, Jul 29, 5:47 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
Ottomata added a comment to T433305: Request creation of pageviews VPS project.

Are there any other relevant tools you might want to have a non commtech VPS project to migrate too? If so, we could think of some more generic name. Otherwise, whatever you like is fine with me.

Wed, Jul 29, 5:38 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal added a comment to T433305: Request creation of pageviews VPS project.

+1 LGTM, in the future would be good IMHO to explore exactly what went wrong with Toolforge, hosting code there would definitely require less maintenance

Wed, Jul 29, 5:33 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
Ottomata added a comment to T433305: Request creation of pageviews VPS project.

Ah, got it.

Wed, Jul 29, 5:33 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
dcaro added a comment to T433305: Request creation of pageviews VPS project.

name pageviews is already taken by the web proxy pageviews.wmcloud.org, we would need either

Oh, sorry, maybe I misunderstood, but I assumed this meant that there was an existent project named pageviews in which the web proxy was configured.

If so, I was suggesting to use the existent pageviews project.

Wed, Jul 29, 5:14 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
Ottomata added a comment to T433305: Request creation of pageviews VPS project.

name pageviews is already taken by the web proxy pageviews.wmcloud.org, we would need either

Oh, sorry, maybe I misunderstood, but I assumed this meant that there was an existent project named pageviews in which the web proxy was configured.

Wed, Jul 29, 5:08 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
bd808 added a comment to T433305: Request creation of pageviews VPS project.

Oh! Can we just use the existent project then? Probably just needs us added as admins.

Wed, Jul 29, 4:53 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
dcaro added a comment to T433305: Request creation of pageviews VPS project.

Oh! Can we just use the existent project then? Probably just needs us added as admins.

Wed, Jul 29, 4:52 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
Ottomata added a comment to T433305: Request creation of pageviews VPS project.

Oh! Can we just use the existent project then? Probably just needs us added as admins.

Wed, Jul 29, 4:47 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
dcaro added a comment to T433305: Request creation of pageviews VPS project.

Hi @MusikAnimal, @Ottomata, the name pageviews is already taken by the web proxy pageviews.wmcloud.org, we would need either changing the webproxy, or this project name so it does not collide (see T360294: [cloud-vps] creating a new project can override existing DNS entries in the wmcloud.org domain), let me know which one and we can continue with this.

Wed, Jul 29, 9:19 AM · Tool-Pageviews, Cloud-VPS (Project-requests)

Tue, Jul 28

dcaro changed the status of T433305: Request creation of pageviews VPS project from Open to In Progress.
Tue, Jul 28, 9:41 AM · Tool-Pageviews, Cloud-VPS (Project-requests)
dcaro claimed T433305: Request creation of pageviews VPS project.
Tue, Jul 28, 9:41 AM · Tool-Pageviews, Cloud-VPS (Project-requests)
fgiunchedi added a comment to T433305: Request creation of pageviews VPS project.

+1 LGTM, in the future would be good IMHO to explore exactly what went wrong with Toolforge, hosting code there would definitely require less maintenance

Tue, Jul 28, 9:40 AM · Tool-Pageviews, Cloud-VPS (Project-requests)
Seb35 added a comment to T433055: Request creation of PanoCommons VPS project.

In addition of @PanierAvide’s comment, I would say this projet is more about the promotion of Commons’ images, in order to share them with the OSM/Panoramax community. This project is similar to WikiMap but with a technology compatible with OSM ecosystem (and Panoramax relying itself on the STAC ecosystem).

Tue, Jul 28, 9:35 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)

Mon, Jul 27

Ottomata updated subscribers of T433305: Request creation of pageviews VPS project.
Mon, Jul 27, 8:56 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal added a parent task for T433305: Request creation of pageviews VPS project: T420834: Move Pageviews tool to Symfony.
Mon, Jul 27, 8:05 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal added a parent task for T433305: Request creation of pageviews VPS project: T378549: Pageviews Analysis 3.0 (Vue + Codex).
Mon, Jul 27, 8:04 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal removed a subtask for T433305: Request creation of pageviews VPS project: T378549: Pageviews Analysis 3.0 (Vue + Codex).
Mon, Jul 27, 8:04 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal added a subtask for T433305: Request creation of pageviews VPS project: T378549: Pageviews Analysis 3.0 (Vue + Codex).
Mon, Jul 27, 8:04 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal updated the task description for T433305: Request creation of pageviews VPS project.
Mon, Jul 27, 8:03 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
MusikAnimal created T433305: Request creation of pageviews VPS project.
Mon, Jul 27, 8:03 PM · Tool-Pageviews, Cloud-VPS (Project-requests)
PanierAvide added a comment to T433055: Request creation of PanoCommons VPS project.

Hi, thanks for your feedback. It doesn't help (yet !) contributing to Commons in terms of data. What we are looking for is making easier to reuse the Commons imagery in various geographical related tools, like:

Mon, Jul 27, 9:32 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)
dcaro added a comment to T433055: Request creation of PanoCommons VPS project.

Hi @Seb35, by the description of the project, it does not seem to be contributing anything back to commons or wikis in general, can you elaborate on how does this specific project help the wiki ecosystem?

Mon, Jul 27, 9:03 AM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)

Fri, Jul 24

Seb35 created T433055: Request creation of PanoCommons VPS project.
Fri, Jul 24, 12:07 PM · tools-platform-team, User-dcaro, Cloud-VPS (Project-requests)

Jul 17 2026

taavi closed T431996: Request creation of vps as Declined.

Closing due to no response to Andre's comment.

Jul 17 2026, 1:48 PM · Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T408387: CloudVPS instance for ProVe.

andrew closed https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/261

Jul 17 2026, 1:19 PM · cloud-services-team (FY2025/2026-Q1-Q2), Cloud-VPS (Project-requests)

Jul 13 2026

Aklapper placed T431996: Request creation of vps up for grabs.

Project Name: wikidata

Jul 13 2026, 1:36 PM · Cloud-VPS (Project-requests)
Chaosnb created T431996: Request creation of vps.
Jul 13 2026, 12:21 PM · Cloud-VPS (Project-requests)

Jul 8 2026

gmodena added a comment to T431531: Request creation of wdp-gitlab-runner VPS project.

Terrific! Thank you so much for picking this task up so quickly. Now let's build :)

Jul 8 2026, 12:37 PM · User-dcaro, Wikidata Platform Team, Cloud-VPS (Project-requests)
dcaro closed T431531: Request creation of wdp-gitlab-runner VPS project as Resolved.
Jul 8 2026, 12:31 PM · User-dcaro, Wikidata Platform Team, Cloud-VPS (Project-requests)
dcaro moved T431531: Request creation of wdp-gitlab-runner VPS project from Doing to Done on the User-dcaro board.
Jul 8 2026, 12:31 PM · User-dcaro, Wikidata Platform Team, Cloud-VPS (Project-requests)
dcaro added a comment to T431531: Request creation of wdp-gitlab-runner VPS project.

Done, enjoy :)

Jul 8 2026, 12:31 PM · User-dcaro, Wikidata Platform Team, Cloud-VPS (Project-requests)
Maintenance_bot removed a project from T431531: Request creation of wdp-gitlab-runner VPS project: Patch-For-Review.
Jul 8 2026, 12:31 PM · User-dcaro, Wikidata Platform Team, Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T431531: Request creation of wdp-gitlab-runner VPS project.

projects: added project wdp-gitlab-runner

Jul 8 2026, 12:23 PM · User-dcaro, Wikidata Platform Team, Cloud-VPS (Project-requests)