Jump to content

FreeBSD/Setup/Area51: Difference between revisions

From KDE Community Wiki
Adridg (talk | contribs)
Tcberner (talk | contribs)
 
(13 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= Area 51 =
= Area 51 repository =


<blockquote>In the KDE3 days, around FreeBSD 5, the repository where KDE ports were developed was called Area 51 -- the famous place where aliens land. We still refer to the ports-development repository as Area 51, even though it is no longer called that in hostname or repository name.</blockquote>
Note: KDE at the moment the repository is mostly used to prepare commits to the main tree; as updates rarely take more than a few hours (or days, in case of an exp-run), the branches are shortlived. So as unless you are trying to contribute to the kde@ maintained ports, there is no real need to track the ports tree, instead of the main, one at the moment


Area 51 is used for development of KDE and Qt ports that are maintained by the KDE on FreeBSD team. Right now, that is for Plasma 5 and the latest (KF5-based) KDE Applications.


<blockquote>In the KDE 3 days, around FreeBSD 5, the repository where KDE ports were developed was called Area 51 – the famous place where aliens land. Although 'area51' no longer appears in the host name or repository name, we still call it Area 51.</blockquote>


Development of the Qt and KDE ports maintained by the KDE on FreeBSD team happens in the area51 repository. New versions and changes the ports are always committed there first and only later hit the ports tree. Even though the ports in the area51 repository are not always in a stable state, users are encouraged to test them and report problems, especially during the ''call for tests'' periods.
Area 51 is used for development of KDE and Qt ports that are maintained by the KDE on FreeBSD team. These ports are not always in a stable state, so users are encouraged to test and report problems, especially during ''call for testing'' (CFT) periods. Area 51 is [https://github.com/freebsd/freebsd-ports-kde/ hosted on GitHub].  


The area51 repository is hosted on [https://github.com/freebsd/freebsd-ports-kde/ github]. The history of commits is recorded in the KDE on FreeBSD mailing list. The workflow is roughly the same as the [https://wiki.freebsd.org/Graphics/Ports%20development%20workflow|XOrg ports] workflow, or the GNOME ports: a complete git clone of the ports tree is kept, branches work on specific updates, and that gets merged to ports master when things are ready.
New versions and changes to ports are always committed here first and only later hit the FreeBSD ports tree. The history of commits is recorded in [https://mail.kde.org/mailman/listinfo/kde-freebsd the KDE on FreeBSD e-mail list]. Workflow is similar to the [https://wiki.freebsd.org/Graphics/Ports%20development%20workflow graphics stack ports development workflow], or GNOME ports: a complete Git clone of the ports tree is kept, branches work on specific updates, and that work gets merged to FreeBSD ports master when things are ready.
 
----


<center><i>HIC SUNT LEONES</i></center>
<center><i>HIC SUNT LEONES</i></center>


== Source Organization ==
= Source organization =
 
The Area 51 ports tree is an official git fork of the official FreeBSD ports tree; it is hosted on GitHub alongside the XOrg and GNOME ports trees. This section talks about the procedures used to keep the ports tree up-to-date. This is for ''maintainers'' of the ports tree, not ''users'' of the ports tree.
 
Most important for maintainers: <b>never push to main except when synchronizing with upstream</b>.
 
== Initial Clone ==
 
This assumes you have a GitHub account and permissions for the KDE-FreeBSD ports tree:
 
{{Input|1=<nowiki>
git clone https://github.com/freebsd/freebsd-ports-kde.git
git remote set-url --push origin [email protected]:freebsd/freebsd-ports-kde.git
git remote add upstream https://github.com/freebsd/freebsd-ports.git</nowiki>}}}
 
== Synchronizing with upstream ==


See the XOrg ports pages.
Do this at least every weekend:


== Packages and Build Status ==
{{Input|1=<nowiki>
git checkout main
git fetch -p upstream
git merge --ff-only upstream/main
git push</nowiki>}}


The current status of some of the branches of the area51 repository can be seen in the FreeBSD Continuous Integration (CI) system, which is a Jenkins instance kindly hosted by one of the team members. The build status can be found [http://jenkins.mouf.net/view/area51/ in Jenkins]. These builds are done from the area51 ports repository, on both 11-STABLE and CURRENT.
== Working on a port ==


Packages may be obtained from the unofficial package repository that is created by the Jenkins CI system. To use these packages, you may add a repository configuration file <code>/usr/local/etc/pkg/repos/area51.conf</code> as follows:
Use a topic branch. Topic branches are local, but you can also push them to the origin for collaboration. Topic branches are cleaned up once they are merged, and there is no need to hang on to them or references to them.
 
To get started:
 
{{Input|1=<nowiki>
git checkout main
git checkout -b my-feature</nowiki>}}
 
Then modify ports, add commits of the changes you make. Since the working copy of the tree is exactly what you are modifying, you can use poudriere to build your changes quite easily.
 
<center><b>Do not ever commit directly to main</b></center>
 
You may push a topic branch to origin; this can be useful for collaboration and for testing purposes.
 
To sync with main (do this before making a PR), first synchronize with upstream, and then merge main into your feature branch; this will show you if anything has changed "out from under you".
 
{{Input|1=<nowiki>
git checkout my-feature
git merge main
# Resolve any issues here
git push # If you want to publish</nowiki>}}
 
To create a diff for PR purposes, first sync with main and resolve any problems, and then diff between main and your feature branch:
 
{{Input|1=<nowiki>
git diff main..my-feature > /tmp/pr.diff</nowiki>}}
 
To clean up: once the PR is landed by a commit to the official FreeBSD SVN ports tree (e.g. by a ports committer), the upstream git mirror will update as well. This may take up to two hours. Then the content of the PR commit is available in the git tree.
 
<center><b>Do not ever merge branches to main.</b></center>
 
You can synchronize with upstream to check that the PR contents have landed properly -- to test, you can checkout main and then use poudriere to build against that tree.
The remaining branches can be pruned, unless you really want to keep development history for them.
 
{{Input|1=<nowiki>
git checkout main
git branch -D my-feature  # Force delete of topic branch
git push origin --delete my-feature # If you published it</nowiki>}}
 
= Packages and build status =
 
The current status of some of the branches of Area 51 can be seen in the FreeBSD continuous integration (CI) system, which is a Jenkins instance kindly hosted by one of the team members:
 
* https://jenkins.mouf.net/view/kde/
 
Builds are done on both STABLE and 12.0-CURRENT.
 
Packages may be obtained from the unofficial repository that is created by the Jenkins CI system. To do this, add a configuration file <code>/usr/local/etc/pkg/repos/area51.conf</code> as follows:
FreeBSD: { enabled: false }
  area51: {
  area51: {
   url: "http://meatwad.mouf.net/rubick/poudriere/packages/110-amd64-area51/"
   url: "http://meatwad.mouf.net/rubick/poudriere/packages/110-amd64-kde/"
   priority: 2
   priority: 2
   enabled: true
   enabled: true
  }
  }
It is strongly advised to disable the official FreeBSD package repository when installing from this unofficial repository, to avoid mixing packages from multiple sources. Set <code>enabled: false</code> in the repository configuration file for the official FreeBSD package repository while testing area51 packages.
The first line disables the official FreeBSD package repository. This avoids mixing packages from multiple sources, and is is strongly advised when using unofficial packages.  


== Poudriere ==
= Poudriere =


We strongly recommend using poudriere for building packages from the area51 repository. These packages can then easily be used with pkg(8). First things first, install poudriere:
We strongly recommend using poudriere for building packages from Area 51. These packages can then easily be used with pkg(8). First things first, install poudriere:


     # pkg install poudriere
     # pkg install poudriere
Line 35: Line 106:
it is recommended to modify `/usr/local/etc/poudriere.conf` to use ZFS.
it is recommended to modify `/usr/local/etc/poudriere.conf` to use ZFS.


=== Setting up the Ports Tree ===
== Setting up the ports tree ==


(''note that this can be done more easily with poudriere-devel'')
(''Note that this can be done more easily with poudriere-devel''.)


With poudriere installed, you must create one or more ports trees (to build from) and one or more jails (to build in). We'll start with the ports tree. Create a tree, but don't populate it; we'll call this ports tree ''freebsd-ports-kde''.
With poudriere installed, you must create one or more ports trees (to build from) and one or more jails (to build in). We'll start with the ports tree. Create a tree, but don't populate it; we'll call this ports tree ''freebsd-ports-kde''.
Line 43: Line 114:
     # poudriere ports -c -F -m git -p freebsd-ports-kde
     # poudriere ports -c -F -m git -p freebsd-ports-kde


Next, clone the ports tree from Area51. This needs to go into the just-created directory for the ports tree, which could be anywhere on your system depending on how poudriere is configured. The default is under `/usr/local/poudriere/ports`. Depending on how you want to access the Github repository, you may need to use a different user or credentials -- this example just does an anonymous clone.
Next, clone the ports tree from Area 51. This needs to go into the just-created directory for the ports tree, which could be anywhere on your system depending on how poudriere is configured. The default is under `/usr/local/poudriere/ports`. Depending on how you want to access Area 51, you may need to use a different user or credentials this example just does an anonymous clone.


     # cd /usr/local/poudriere/ports
     # cd /usr/local/poudriere/ports
     # git clone https://github.com/freebsd/freebsd-ports-kde
     # git clone https://github.com/freebsd/freebsd-ports-kde


With this setup, you can `git pull` and otherwise update the git repository as you see fit: it is the working directory that will be used for the ports tree (so you can switch branches inside the clone, too).
With this setup, you can <code>git pull</code> and otherwise update the Git repository as you see fit: it is the working directory that will be used for the ports tree (so you can switch branches inside the clone, too).
 
== Picking the right branch ==
 
The ports tree which has been cloned, above, has checked out the ''master'' branch. Master always follows the official FreeBSD ports tree, so it is not very interesting compared to the other branches in the Area 51 repository. Note, too, that master may lag behind the official ports: the KDE-FreeBSD team synchronizes master with the official ports tree at least every weekend.
 
Use <code>git branch -a</code> to see which branches are available. As of mid-june, 2017, there are the following branches:
* ''kde5-import'', which contains the complete KDE Frameworks, Plasma Workspace, and KDE Applications. This is probably the branch you want.
* ''kde5.9-import'', same as above, but with Qt-5.9 mixed in
* ''qt-5.9, Qt-5.9 work in progress ports
* ''kdevelop-5'', ''kdenlive-17.04'', which are branches updating only a single application or collection of related ports to the KDE Frameworks-based version of that application.
* ''cmake-x.y'', which contains preparations for the release of CMake x.y -- (for some valid combination of x and y).
 
Use <code>git checkout kde5-import</code> to switch to the ''kde5-import' branch, which is the one most likely to be useful at this point (december 2017).


=== Setting up the Build Jail ===
== Setting up the build jail ==


Create a jail to build in; this is essentially a whole new FreeBSD installation inside your existing one. It can also be an older FreeBSD version (newer than the host system is not recommended and may not work at all). This command creates a new 11.0 jail, calling it ''110amd64'':
Create a jail to build in; this is essentially a whole new FreeBSD installation inside your existing one. It can also be an older FreeBSD version (newer than the host system is not recommended and may not work at all). This command creates a new 11.0 jail, calling it ''110amd64'', and installs the jail over FTP:


     # poudriere jail -c -j 110amd64 -v 11.0-STABLE -m ftp
     # poudriere jail -c -j 110amd64 -v 11.0-STABLE -m ftp


=== Running a Build ===
== Running a build ==


Poudriere can bulk-build ports, given a jail and a ports tree to work with. It will generally rebuild all that is needed; assuming you are most interested in all the latest KDE software, the metaport `x11/kde5` is the one to rebuild.
Poudriere can bulk-build ports, given a jail and a ports tree to work with. It will generally rebuild all that is needed; assuming you are most interested in all the latest KDE software, the metaport <code>x11/kde5</code> is the one to rebuild.


     # poudriere bulk -j 110amd64 -p freebsd-ports-kde x11/kde5
     # poudriere bulk -j 110amd64 -p freebsd-ports-kde x11/kde5

Latest revision as of 16:28, 7 May 2021

Area 51 repository

Note: KDE at the moment the repository is mostly used to prepare commits to the main tree; as updates rarely take more than a few hours (or days, in case of an exp-run), the branches are shortlived. So as unless you are trying to contribute to the kde@ maintained ports, there is no real need to track the ports tree, instead of the main, one at the moment

Area 51 is used for development of KDE and Qt ports that are maintained by the KDE on FreeBSD team. Right now, that is for Plasma 5 and the latest (KF5-based) KDE Applications.

In the KDE 3 days, around FreeBSD 5, the repository where KDE ports were developed was called Area 51 – the famous place where aliens land. Although 'area51' no longer appears in the host name or repository name, we still call it Area 51.

Area 51 is used for development of KDE and Qt ports that are maintained by the KDE on FreeBSD team. These ports are not always in a stable state, so users are encouraged to test and report problems, especially during call for testing (CFT) periods. Area 51 is hosted on GitHub.

New versions and changes to ports are always committed here first and only later hit the FreeBSD ports tree. The history of commits is recorded in the KDE on FreeBSD e-mail list. Workflow is similar to the graphics stack ports development workflow, or GNOME ports: a complete Git clone of the ports tree is kept, branches work on specific updates, and that work gets merged to FreeBSD ports master when things are ready.


HIC SUNT LEONES

Source organization

The Area 51 ports tree is an official git fork of the official FreeBSD ports tree; it is hosted on GitHub alongside the XOrg and GNOME ports trees. This section talks about the procedures used to keep the ports tree up-to-date. This is for maintainers of the ports tree, not users of the ports tree.

Most important for maintainers: never push to main except when synchronizing with upstream.

Initial Clone

This assumes you have a GitHub account and permissions for the KDE-FreeBSD ports tree:

git clone https://github.com/freebsd/freebsd-ports-kde.git
git remote set-url --push origin [email protected]:freebsd/freebsd-ports-kde.git
git remote add upstream https://github.com/freebsd/freebsd-ports.git

}

Synchronizing with upstream

Do this at least every weekend:

git checkout main
git fetch -p upstream
git merge --ff-only upstream/main
git push

Working on a port

Use a topic branch. Topic branches are local, but you can also push them to the origin for collaboration. Topic branches are cleaned up once they are merged, and there is no need to hang on to them or references to them.

To get started:

git checkout main
git checkout -b my-feature

Then modify ports, add commits of the changes you make. Since the working copy of the tree is exactly what you are modifying, you can use poudriere to build your changes quite easily.

Do not ever commit directly to main

You may push a topic branch to origin; this can be useful for collaboration and for testing purposes.

To sync with main (do this before making a PR), first synchronize with upstream, and then merge main into your feature branch; this will show you if anything has changed "out from under you".

git checkout my-feature
git merge main
# Resolve any issues here
git push # If you want to publish

To create a diff for PR purposes, first sync with main and resolve any problems, and then diff between main and your feature branch:

git diff main..my-feature > /tmp/pr.diff

To clean up: once the PR is landed by a commit to the official FreeBSD SVN ports tree (e.g. by a ports committer), the upstream git mirror will update as well. This may take up to two hours. Then the content of the PR commit is available in the git tree.

Do not ever merge branches to main.

You can synchronize with upstream to check that the PR contents have landed properly -- to test, you can checkout main and then use poudriere to build against that tree. The remaining branches can be pruned, unless you really want to keep development history for them.

git checkout main
git branch -D my-feature  # Force delete of topic branch
git push origin --delete my-feature # If you published it

Packages and build status

The current status of some of the branches of Area 51 can be seen in the FreeBSD continuous integration (CI) system, which is a Jenkins instance kindly hosted by one of the team members:

Builds are done on both STABLE and 12.0-CURRENT.

Packages may be obtained from the unofficial repository that is created by the Jenkins CI system. To do this, add a configuration file /usr/local/etc/pkg/repos/area51.conf as follows:

FreeBSD: { enabled: false }
area51: {
  url: "http://meatwad.mouf.net/rubick/poudriere/packages/110-amd64-kde/"
  priority: 2
  enabled: true
}

The first line disables the official FreeBSD package repository. This avoids mixing packages from multiple sources, and is is strongly advised when using unofficial packages.

Poudriere

We strongly recommend using poudriere for building packages from Area 51. These packages can then easily be used with pkg(8). First things first, install poudriere:

   # pkg install poudriere

it is recommended to modify `/usr/local/etc/poudriere.conf` to use ZFS.

Setting up the ports tree

(Note that this can be done more easily with poudriere-devel.)

With poudriere installed, you must create one or more ports trees (to build from) and one or more jails (to build in). We'll start with the ports tree. Create a tree, but don't populate it; we'll call this ports tree freebsd-ports-kde.

   # poudriere ports -c -F -m git -p freebsd-ports-kde

Next, clone the ports tree from Area 51. This needs to go into the just-created directory for the ports tree, which could be anywhere on your system depending on how poudriere is configured. The default is under `/usr/local/poudriere/ports`. Depending on how you want to access Area 51, you may need to use a different user or credentials – this example just does an anonymous clone.

   # cd /usr/local/poudriere/ports
   # git clone https://github.com/freebsd/freebsd-ports-kde

With this setup, you can git pull and otherwise update the Git repository as you see fit: it is the working directory that will be used for the ports tree (so you can switch branches inside the clone, too).

Picking the right branch

The ports tree which has been cloned, above, has checked out the master branch. Master always follows the official FreeBSD ports tree, so it is not very interesting compared to the other branches in the Area 51 repository. Note, too, that master may lag behind the official ports: the KDE-FreeBSD team synchronizes master with the official ports tree at least every weekend.

Use git branch -a to see which branches are available. As of mid-june, 2017, there are the following branches:

  • kde5-import, which contains the complete KDE Frameworks, Plasma Workspace, and KDE Applications. This is probably the branch you want.
  • kde5.9-import, same as above, but with Qt-5.9 mixed in
  • qt-5.9, Qt-5.9 work in progress ports
  • kdevelop-5, kdenlive-17.04, which are branches updating only a single application or collection of related ports to the KDE Frameworks-based version of that application.
  • cmake-x.y, which contains preparations for the release of CMake x.y -- (for some valid combination of x and y).

Use git checkout kde5-import to switch to the kde5-import' branch, which is the one most likely to be useful at this point (december 2017).

Setting up the build jail

Create a jail to build in; this is essentially a whole new FreeBSD installation inside your existing one. It can also be an older FreeBSD version (newer than the host system is not recommended and may not work at all). This command creates a new 11.0 jail, calling it 110amd64, and installs the jail over FTP:

   # poudriere jail -c -j 110amd64 -v 11.0-STABLE -m ftp

Running a build

Poudriere can bulk-build ports, given a jail and a ports tree to work with. It will generally rebuild all that is needed; assuming you are most interested in all the latest KDE software, the metaport x11/kde5 is the one to rebuild.

   # poudriere bulk -j 110amd64 -p freebsd-ports-kde x11/kde5