You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 14:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Mon Mar 23, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1509032994136,4cyclictest1800334-21apt-get23:50:111
1509034993429,3cyclictest1592739-21/usr/sbin/munin20:30:152
1509032993430,2cyclictest1728102-21apt-get22:40:131
1509024993327,4cyclictest1800070-21latency_hist23:50:010
1509038993226,4cyclictest1513810-21kworker/u8:2+flush-259:019:25:173
1509032993227,4cyclictest1603490-21apt-get20:40:121
1509032993127,3cyclictest1582441-21apt-get20:20:111
1509024993126,4cyclictest1659454-21ntpq21:30:220
1509038993023,5cyclictest1763140-21ntpq23:10:193
1509034993024,4cyclictest1769575-21diskstats23:20:132
1509024992926,2cyclictest1587577-21kworker/u8:0+flush-259:020:35:160
1509032992723,3cyclictest1634126-21kworker/u8:2+events_unbound21:10:181
1509032992723,3cyclictest1545840-21apt-get19:45:121
1509032992721,4cyclictest1534881-21latency_hist19:35:001
1509024992723,3cyclictest1524509-21kworker/u8:3+flush-259:020:25:180
1509024992721,5cyclictest1560632-21ntpq19:55:200
1509024992720,5cyclictest1721732-21ntpq22:30:200
1509034992621,3cyclictest1519563-21/usr/sbin/munin19:20:252
1509034992620,4cyclictest1535115-21/usr/sbin/munin19:35:152
1509032992622,3cyclictest1774554-21apt-get23:25:131
1509032992622,3cyclictest1774554-21apt-get23:25:131
1509038992519,4cyclictest1846521-21base6400:35:013
1509032992520,4cyclictest1753998-21apt-get23:05:111
1509032992520,3cyclictest1597646-21gpgv20:35:001
1509024992521,3cyclictest1603461-21kworker/u8:2+flush-259:020:40:210
1509034992419,4cyclictest1524509-21kworker/u8:3+flush-259:019:50:262
1509034992419,3cyclictest252-21systemd-journal00:28:492
1509032992420,3cyclictest1618346-21kworker/u8:1+flush-259:021:05:191
1509032992419,4cyclictest1540723-21apt-get19:40:111
1509038992318,4cyclictest1524509-21kworker/u8:3+flush-259:019:45:163
1509034992318,3cyclictest1655175-21kworker/u8:0+flush-259:021:30:252
1509032992319,3cyclictest1660577-21kworker/u8:3+flush-259:022:50:001
1509032992318,4cyclictest252-21systemd-journal23:45:011
1509024992319,3cyclictest1613530-21cron20:49:590
1509024992316,5cyclictest1513262-21ntpq19:10:220
1509038992219,2cyclictest1587577-21kworker/u8:0+flush-259:020:50:263
1509032992219,2cyclictest1618346-21kworker/u8:1+flush-259:020:55:211
1509032992218,3cyclictest1815232-21kworker/u8:2+flush-259:000:30:241
1509032992218,3cyclictest1655175-21kworker/u8:0+flush-259:021:50:211
1509032992216,5cyclictest1528875-21ntpq19:25:221
1509038992117,3cyclictest507-21in:imuxsock21:39:593
1509038992114,5cyclictest1794068-21ntpq23:40:213
1509034992117,3cyclictest1613812-21apt-get20:50:122
1509034992116,3cyclictest252-21systemd-journal21:21:112
1509034992116,3cyclictest252-21systemd-journal20:36:012
1509034992115,3cyclictest1660577-21kworker/u8:3+events_unbound23:15:152
1509032992117,3cyclictest1774279-21idleruntime-cro23:24:591
1509032992117,3cyclictest1660577-21kworker/u8:3+flush-259:021:40:281
1509032992117,3cyclictest1655175-21kworker/u8:0+flush-259:021:45:251
1509032992117,3cyclictest1634126-21kworker/u8:2+events_unbound21:30:181
1509032992115,5cyclictest1722882-21kworker/u8:4+events_unbound22:35:141
1509024992117,3cyclictest1680917-21kworker/u8:1+flush-259:022:55:220
1509038992015,3cyclictest1519368-21kworker/u8:1+flush-259:019:30:163
1509038992014,4cyclictest1759110-21kworker/u8:0+flush-259:023:30:253
1509034992016,3cyclictest1795142-21kworker/u8:1+flush-259:023:50:212
1509034992016,3cyclictest1634126-21kworker/u8:2+flush-259:021:25:162
1509034992015,3cyclictest1561555-21kworker/u8:2+events_unbound20:05:192
1509032992018,1cyclictest1686063-21munin-plugin-st22:00:011
1509032992016,3cyclictest1551392-21kworker/u8:1+events_unbound20:10:221
1509032992016,2cyclictest0-21swapper/100:20:001
1509032992015,3cyclictest1577279-21apt-get20:15:121
1509024992015,4cyclictest1831195-21apt-get00:20:110
1509024992015,4cyclictest1628036-21ntpq21:00:210
1509038991915,3cyclictest1660577-21kworker/u8:3+flush-259:022:40:183
1509038991913,4cyclictest252-21systemd-journal19:40:003
1509034991916,2cyclictest1561555-21kworker/u8:2+events_unbound20:20:182
1509034991912,5cyclictest252-21systemd-journal00:35:002
1509032991915,3cyclictest1820656-21kworker/u8:3+flush-259:000:35:191
1509032991913,4cyclictest1717584-21base6422:30:011
1509032991913,4cyclictest1540249-21gpgv19:40:011
1509032991912,5cyclictest1628959-21latency_hist21:05:011
1509024991916,2cyclictest1655175-21kworker/u8:0+flush-259:021:45:170
1509038991812,4cyclictest252-21systemd-journal20:20:573
150903499186,6cyclictest1691271-21idleruntime-cro22:05:002
1509032991814,2cyclictest1598712-21grep20:35:161
1509032991813,3cyclictest1587577-21kworker/u8:0+flush-259:020:25:251
1509024991815,2cyclictest1509032-21cyclictest19:10:010
1509024991813,4cyclictest1680917-21kworker/u8:1+flush-259:022:10:240
1509024991813,3cyclictest1645093-21apt-get21:20:130
1509038991713,3cyclictest1545595-21kworker/u8:0+flush-259:019:55:173
1509038991710,5cyclictest1638858-21ntpq21:10:213
1509034991713,3cyclictest1795586-21irqcore23:45:162
1509032991714,2cyclictest1763997-21cron23:15:001
1509032991713,3cyclictest1524509-21kworker/u8:3+flush-259:019:50:211
1509024991714,2cyclictest60350irq/132-enp0s29f1:rx-020:18:180
1509024991714,2cyclictest60350irq/132-enp0s29f1:rx-000:17:190
1509024991713,3cyclictest1561555-21kworker/u8:2+flush-259:020:20:310
1509038991614,1cyclictest0-21swapper/321:55:003
1509038991613,2cyclictest0-21swapper/319:50:173
1509038991611,3cyclictest1587577-21kworker/u8:0+flush-259:020:40:163
1509034991612,3cyclictest1691522-21apt-get22:05:112
1509034991610,4cyclictest252-21systemd-journal22:15:552
1509032991612,3cyclictest1820656-21kworker/u8:3+flush-259:000:20:161
1509032991612,3cyclictest1680917-21kworker/u8:1+events_unbound22:55:141
1509032991611,4cyclictest1680917-21kworker/u8:1+flush-259:022:00:251
150902499169,5cyclictest1634950-21diskstats21:10:130
1509024991614,1cyclictest60350irq/132-enp0s29f1:rx-023:40:140
1509024991614,1cyclictest60350irq/132-enp0s29f1:rx-022:51:170
1509024991614,1cyclictest60350irq/132-enp0s29f1:rx-022:20:140
1509024991614,1cyclictest60350irq/132-enp0s29f1:rx-020:03:230
1509024991613,2cyclictest60350irq/132-enp0s29f1:rx-020:05:150
1509024991613,2cyclictest60350irq/132-enp0s29f1:rx-019:34:340
1509024991612,3cyclictest1466800-21kworker/u8:0+events_unbound19:20:200
1509024991611,3cyclictest1629227-21apt-get21:05:140
1509038991511,3cyclictest1524509-21kworker/u8:3+flush-259:021:00:263
150903499159,4cyclictest252-21systemd-journal21:17:572
1509034991512,2cyclictest1717441-21apt-key22:30:002
1509034991512,2cyclictest1550758-21http19:50:002
1509034991511,3cyclictest1524509-21kworker/u8:3+flush-259:020:28:272
1509034991510,3cyclictest1716723-21kworker/u8:2+flush-259:022:50:172
1509032991511,3cyclictest1660577-21kworker/u8:3+flush-259:022:15:251
1509032991511,2cyclictest0-21swapper/123:00:171
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-023:52:140
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:240
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:230
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-023:10:100
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:250
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:140
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-020:50:240
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:210
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-019:43:070
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-019:35:240
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-019:25:130
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-019:15:480
1509024991513,1cyclictest60350irq/132-enp0s29f1:rx-000:11:000
1509024991512,2cyclictest60350irq/132-enp0s29f1:rx-023:35:200
1509024991512,2cyclictest60350irq/132-enp0s29f1:rx-023:20:230
1509024991512,2cyclictest60350irq/132-enp0s29f1:rx-023:09:470
1509024991512,2cyclictest60350irq/132-enp0s29f1:rx-022:40:240
1509024991512,2cyclictest60350irq/132-enp0s29f1:rx-021:42:450
1509024991512,2cyclictest60350irq/132-enp0s29f1:rx-020:14:020
1509024991512,1cyclictest0-21swapper/022:50:000
1509024991510,3cyclictest1639972-21apt-get21:15:100
150903899148,4cyclictest1540554-21base6419:40:023
1509038991412,1cyclictest1826456-21irqcore00:15:163
1509038991411,2cyclictest1691662-21cpuspeed_turbos22:05:133
1509038991411,2cyclictest1634433-21apt-key21:10:003
1509038991410,3cyclictest252-21systemd-journal21:30:013
1509038991410,3cyclictest252-21systemd-journal00:35:153
1509038991410,3cyclictest1784830-21apt-get23:35:113
150903499148,3cyclictest1670591-21latency_hist21:45:012
1509034991411,2cyclictest1744082-21sed22:55:132
1509034991411,2cyclictest1619383-21irqcore20:55:162
1509034991411,1cyclictest0-21swapper/221:10:002
150903299149,4cyclictest1655175-21kworker/u8:0+flush-259:021:35:211
150903299149,4cyclictest1561555-21kworker/u8:2+events_unbound20:05:221
150903299148,4cyclictest1513810-21kworker/u8:2+events_unbound19:15:161
1509032991411,2cyclictest1820634-21latency_hist00:10:001
1509032991411,2cyclictest0-21swapper/122:20:171
1509024991412,1cyclictest60350irq/132-enp0s29f1:rx-023:18:300
1509024991412,1cyclictest60350irq/132-enp0s29f1:rx-021:59:170
1509024991412,1cyclictest60350irq/132-enp0s29f1:rx-021:25:230
1509024991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:220
1509024991412,1cyclictest60350irq/132-enp0s29f1:rx-000:28:000
1509024991412,1cyclictest60350irq/132-enp0s29f1:rx-000:00:180
1509024991411,2cyclictest60350irq/132-enp0s29f1:rx-019:50:210
1509024991411,2cyclictest60350irq/132-enp0s29f1:rx-000:30:240
150903899138,3cyclictest513-21gdbus22:30:013
1509038991310,2cyclictest0-21swapper/320:59:593
150903499139,3cyclictest1820656-21kworker/u8:3+flush-259:000:20:182
150903499139,3cyclictest1524509-21kworker/u8:3+flush-259:020:04:012
150903499139,2cyclictest1518515-21smartctl19:15:232
150903499137,4cyclictest1820631-21latency_hist00:10:012
150903499136,5cyclictest1542999-21sed19:40:172
1509034991310,2cyclictest0-21swapper/222:35:012
150903299138,4cyclictest1524509-21kworker/u8:3+events_unbound20:00:231
150903299137,4cyclictest1660577-21kworker/u8:3+events_unbound23:55:221
1509032991310,2cyclictest1660577-21kworker/u8:3+flush-259:000:00:251
1509032991310,2cyclictest1618346-21kworker/u8:1+events_unbound21:15:211
1509032991310,2cyclictest0-21swapper/121:20:161
150903299130,5cyclictest1514171-21basename19:15:001
1509024991312,1cyclictest60350irq/132-enp0s29f1:rx-022:29:560
1509024991311,1cyclictest60350irq/132-enp0s29f1:rx-019:47:430
1509024991311,1cyclictest60350irq/132-enp0s29f1:rx-000:05:220
1509024991310,2cyclictest60350irq/132-enp0s29f1:rx-023:55:130
1509024991310,2cyclictest60350irq/132-enp0s29f1:rx-022:15:240
1509024991310,2cyclictest60350irq/132-enp0s29f1:rx-020:55:160
150903899129,2cyclictest1567215-21fschecks_time20:05:163
150903899129,2cyclictest0-21swapper/323:15:223
150903899129,1cyclictest0-21swapper/321:40:233
150903899129,1cyclictest0-21swapper/320:35:013
150903899127,4cyclictest1670854-21apt-get21:45:123
150903899127,3cyclictest252-21systemd-journal22:01:193
150903899120,10cyclictest252-21systemd-journal22:30:023
150903499129,2cyclictest1826436-21irqcore00:15:162
150903499129,2cyclictest1628137-21ntp_offset21:00:242
150903499128,2cyclictest0-21swapper/220:15:002
150903499126,4cyclictest252-21systemd-journal19:30:002
150903499126,4cyclictest1660574-21apt-get21:35:092
150903499125,1cyclictest0-21swapper/223:45:002
150903299128,2cyclictest1-21systemd22:30:001
150903299127,4cyclictest1695675-21ps22:05:231
1509024991210,1cyclictest60350irq/132-enp0s29f1:rx-023:31:310
1509024991210,1cyclictest60350irq/132-enp0s29f1:rx-023:00:500
1509024991210,1cyclictest60350irq/132-enp0s29f1:rx-021:52:540
150903899119,1cyclictest0-21swapper/319:15:163
150903899118,2cyclictest1749036-21fschecks_count23:00:153
150903899115,4cyclictest1800621-21fw_forwarded_lo23:50:143
150903499118,2cyclictest1530073-21cpuspeed_turbos19:30:132
150903499111,8cyclictest1514151-21awk19:15:012
150903299118,2cyclictest1652221-21kthreadcore21:25:171
150903299117,3cyclictest1797472-21kthreadcore23:45:191
150903299117,3cyclictest1460997-21kworker/u8:4+flush-259:019:20:261
150903299116,4cyclictest1759110-21kworker/u8:0+flush-259:023:30:201
150903299114,5cyclictest1561515-21cron20:00:001
150902499119,1cyclictest60350irq/132-enp0s29f1:rx-022:05:190
150903899103,1cyclictest16096442uname20:45:173
150903899100,8cyclictest1577010-21awk20:15:003
150903499108,1cyclictest1810684-21cpuspeed_turbos00:00:142
150903499108,1cyclictest0-21swapper/223:10:002
150903499107,2cyclictest1577344-21cpuspeed_turbos20:15:142
150903299106,2cyclictest0-21swapper/122:50:181
15090389996,2cyclictest0-21swapper/321:55:153
15090329997,1cyclictest0-21swapper/100:25:151
15090249990,8cyclictest1723821-21irqcore22:35:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional