You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 04:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Apr 26, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1315561994539,4cyclictest1445040-21latency_hist21:15:003
1315551994438,4cyclictest1517882-21ntpq22:20:230
131555199422,38cyclictest1-21systemd20:40:010
1315556994134,5cyclictest1570157-21latency_hist23:15:001
1315558994036,3cyclictest1445301-21apt-get21:15:122
1315561993934,3cyclictest1559835-21latency_hist23:05:013
1315558993936,2cyclictest1450236-21kworker/u8:3+flush-259:023:55:212
1315558993832,4cyclictest1393314-21latency_hist20:25:002
1315556993729,5cyclictest1482304-21cp21:50:011
1315551993732,3cyclictest252-21systemd-journal00:27:320
1315551993632,3cyclictest1595992-21kworker/u8:1+flush-259:023:50:210
1315561993428,4cyclictest1481076-21ntpq21:45:223
1315556993429,3cyclictest252-21systemd-journal22:17:401
1315551993327,4cyclictest1444109-21ntpq21:10:210
1315558993229,2cyclictest1595992-21kworker/u8:1+flush-259:000:20:002
1315558993228,3cyclictest1616621-21kworker/u8:2+flush-259:000:25:212
1315558993228,3cyclictest1492658-21kworker/u8:1+flush-259:022:45:222
1315558993228,3cyclictest1403785-21kworker/u8:0+flush-259:021:15:002
1315556993127,3cyclictest1409200-21apt-get20:40:111
1315556993125,4cyclictest1330958-21latency_hist19:25:001
1315551993126,3cyclictest509-21rs:main0
1315558992924,4cyclictest1627548-21apt-get00:10:132
1315558992924,3cyclictest1357288-21base6419:50:012
1315556992923,4cyclictest252-21systemd-journal19:30:001
1315551992923,4cyclictest1595967-21latency_hist23:40:000
1315561992823,4cyclictest1394022-21kworker/u8:2+flush-259:020:35:013
1315558992824,3cyclictest1616621-21kworker/u8:2+events_unbound00:30:222
1315558992822,4cyclictest1601579-21diskstats23:45:142
1315556992822,4cyclictest252-21systemd-journal21:25:001
1315556992822,4cyclictest1325797-21latency_hist19:20:011
1315556992820,5cyclictest1398591-21latency_hist20:30:011
1315561992723,3cyclictest1403785-21kworker/u8:0+flush-259:020:50:013
1315561992720,5cyclictest252-21systemd-journal00:30:013
1315558992723,3cyclictest1283385-21kworker/u8:1+flush-259:020:00:012
1315558992722,3cyclictest252-21systemd-journal19:50:002
1315556992721,4cyclictest252-21systemd-journal21:31:331
1315556992720,5cyclictest1466290-21cp21:35:011
1315551992724,2cyclictest1283385-21kworker/u8:1+events_unbound19:25:240
1315551992722,3cyclictest1450236-21kworker/u8:3+flush-259:022:15:160
1315551992720,5cyclictest1376961-21ntpq20:05:220
1315556992621,3cyclictest1611694-21apt-get23:55:111
1315556992619,5cyclictest1560075-21/usr/sbin/munin23:05:151
1315561992519,4cyclictest1388159-21latency_hist20:20:013
1315561992518,5cyclictest1464815-21ntpq21:30:243
1315561992518,5cyclictest1454544-21ntpq21:20:233
1315558992522,2cyclictest1403785-21kworker/u8:0+flush-259:021:35:152
1315558992521,3cyclictest252-21systemd-journal19:26:332
1315558992518,5cyclictest1620839-21ntpq00:00:222
1315556992521,3cyclictest1621772-21gpgv00:05:001
1315551992522,2cyclictest1450236-21kworker/u8:3+flush-259:021:40:210
1315551992521,3cyclictest1310431-21kworker/u8:3+events_unbound20:30:150
1315561992419,4cyclictest1283385-21kworker/u8:1+flush-259:020:05:263
1315558992422,1cyclictest0-21swapper/220:40:002
1315558992421,2cyclictest1283385-21kworker/u8:1+flush-259:020:05:012
1315551992421,2cyclictest1450236-21kworker/u8:3+flush-259:022:35:170
1315551992420,3cyclictest1595992-21kworker/u8:1+events_unbound00:05:230
1315551992420,3cyclictest1595992-21kworker/u8:1+events_unbound00:05:220
1315551992420,3cyclictest1450236-21kworker/u8:3+events_unbound23:40:160
1315551992418,5cyclictest1616592-21latency_hist00:00:010
1315551992418,4cyclictest1548680-21ntpq22:50:210
1315561992320,2cyclictest1392815-21kworker/u8:1+flush-259:020:25:013
1315561992318,3cyclictest1429788-21/usr/sbin/munin21:00:153
1315558992320,2cyclictest1492658-21kworker/u8:1+events_unbound23:20:222
1315558992320,2cyclictest1492658-21kworker/u8:1+events_unbound22:20:252
1315558992318,4cyclictest1424611-21/usr/sbin/munin20:55:142
1315551992319,3cyclictest1482607-21apt-get21:50:130
1315551992317,4cyclictest1642727-21latency_hist00:25:010
1315551992316,5cyclictest252-21systemd-journal00:35:000
1315551992316,5cyclictest1424378-21latency_hist20:55:010
1315561992218,3cyclictest252-21systemd-journal23:20:003
1315561992217,3cyclictest252-21systemd-journal00:16:333
1315561992215,5cyclictest1450219-21latency_hist21:20:003
1315558992219,2cyclictest1492658-21kworker/u8:1+flush-259:022:05:232
1315558992219,2cyclictest1403785-21kworker/u8:0+flush-259:021:34:582
1315558992219,2cyclictest1403785-21kworker/u8:0+flush-259:021:25:212
1315558992218,3cyclictest1403785-21kworker/u8:0+flush-259:022:00:252
1315556992218,3cyclictest1585615-21kworker/u8:2+flush-259:023:40:241
1315556992216,4cyclictest1580747-21apt-get23:25:121
1315551992219,2cyclictest1320585-21kworker/u8:0+events_unbound19:15:230
1315561992117,3cyclictest1394022-21kworker/u8:2+flush-259:020:39:393
1315561992114,5cyclictest1356779-21apt-get19:50:003
1315558992118,2cyclictest1616621-21kworker/u8:2+events_unbound00:20:232
1315558992118,2cyclictest1320585-21kworker/u8:0+flush-259:019:20:272
1315556992117,2cyclictest0-21swapper/121:20:001
1315556992116,3cyclictest1616621-21kworker/u8:2+flush-259:000:20:181
1315551992118,2cyclictest1439865-21cron21:10:000
1315551992117,3cyclictest1492658-21kworker/u8:1+flush-259:023:25:250
131555199210,19cyclictest1-21systemd23:08:330
1315561992016,3cyclictest1476355-21apt-get21:45:003
1315561992016,2cyclictest0-21swapper/323:55:013
1315561992014,4cyclictest252-21systemd-journal22:55:013
1315561992014,4cyclictest1529027-21latency_hist22:35:013
1315561992014,4cyclictest1502941-21latency_hist22:10:013
1315558992017,2cyclictest507-21in:imuxsock22:00:002
1315558992017,2cyclictest1450236-21kworker/u8:3+events_unbound23:30:162
131555699208,10cyclictest252-21systemd-journal22:49:331
1315556992016,3cyclictest1450236-21kworker/u8:3+flush-259:022:25:221
1315556992015,4cyclictest252-21systemd-journal19:50:331
1315556992014,4cyclictest1642986-21apt-get00:25:101
1315556992014,4cyclictest1632419-21latency_hist00:15:001
1315551992017,2cyclictest1616621-21kworker/u8:2+events_unbound00:35:230
1315551992017,2cyclictest1403785-21kworker/u8:0+flush-259:021:15:150
1315551992016,3cyclictest1595992-21kworker/u8:1+events_unbound00:10:250
1315551992016,3cyclictest1403785-21kworker/u8:0+events_unbound20:40:170
1315551992014,4cyclictest509-21rs:main0
1315561991915,3cyclictest1455631-21apt-get21:25:123
1315561991914,4cyclictest1403785-21kworker/u8:0+flush-259:022:00:263
1315558991916,2cyclictest1450236-21kworker/u8:3+events_unbound22:35:242
1315558991915,3cyclictest1315755-21/usr/sbin/munin19:10:212
1315558991915,3cyclictest1283385-21kworker/u8:1+flush-259:020:05:172
131555699196,11cyclictest513-21gdbus22:55:011
1315556991914,3cyclictest1419506-21apt-get20:50:121
1315551991914,4cyclictest1315492-21latency_hist19:10:000
1315551991913,4cyclictest1492618-21latency_hist22:00:010
1315558991815,2cyclictest1349038-21kthreadcore19:40:172
1315558991814,3cyclictest509-21rs:main2
1315558991814,3cyclictest1403785-21kworker/u8:0+flush-259:021:00:242
1315558991813,4cyclictest1534448-21apt-get22:40:142
1315558991811,5cyclictest1477204-21diskstats21:45:152
131555699184,3cyclictest252-21systemd-journal19:42:331
1315556991814,3cyclictest1300252-21kworker/u8:2+flush-259:019:10:171
1315556991814,2cyclictest1503625-21irqcore22:10:161
1315556991813,4cyclictest1283385-21kworker/u8:1+flush-259:020:00:281
1315551991814,3cyclictest252-21systemd-journal20:57:330
1315551991814,2cyclictest0-21swapper/021:35:000
1315561991713,2cyclictest1-21systemd22:44:333
1315561991712,3cyclictest252-21systemd-journal23:45:333
1315561991712,3cyclictest1487925-21diskstats21:55:133
1315561991710,5cyclictest1346476-21latency_hist19:40:013
1315558991713,3cyclictest1450236-21kworker/u8:3+flush-259:021:40:212
1315558991712,4cyclictest1513394-21cp22:20:012
1315558991711,4cyclictest1507152-21ntpq22:10:202
131555699176,1cyclictest0-21swapper/122:35:151
131555699175,2cyclictest1601484-21cpuspeed_turbos23:45:141
131555699171,4cyclictest1575315-21basename23:19:591
1315556991713,3cyclictest1403785-21kworker/u8:0+flush-259:021:25:261
1315556991712,3cyclictest1549834-21/usr/sbin/munin22:55:201
131555699170,4cyclictest1367522-21awk20:00:001
1315551991715,1cyclictest0-21swapper/020:50:000
1315551991713,2cyclictest0-21swapper/022:10:160
1315551991712,4cyclictest1450236-21kworker/u8:3+flush-259:021:35:250
1315551991710,5cyclictest1366618-21ntpq19:55:200
1315561991613,1cyclictest0-21swapper/322:20:003
1315561991612,3cyclictest1450236-21kworker/u8:3+flush-259:023:30:263
1315561991612,3cyclictest1300252-21kworker/u8:2+flush-259:019:10:503
1315561991610,4cyclictest1481921-21apt-get21:50:013
131555899163,6cyclictest1570162-21munin-run23:14:592
1315558991614,1cyclictest1398595-21latency_hist20:30:012
1315558991614,1cyclictest1321307-21irqcore19:15:182
1315558991612,3cyclictest1585615-21kworker/u8:2+events_unbound23:35:142
1315558991612,3cyclictest1492658-21kworker/u8:1+flush-259:023:15:192
1315558991611,4cyclictest1403785-21kworker/u8:0+flush-259:021:10:002
131555699164,3cyclictest1623614-21tr00:05:181
131555699164,3cyclictest1623614-21tr00:05:181
131555699164,3cyclictest1591185-21cut23:35:121
131555699164,1cyclictest0-21swapper/120:15:011
131555699161,5cyclictest1408947-21munin-run20:40:011
131555699161,4cyclictest1487505-21idleruntime-cro21:55:001
131555699160,4cyclictest1336797-21cut19:30:171
1315551991614,2cyclictest1450236-21kworker/u8:3+events_unbound23:30:240
1315551991614,1cyclictest60350irq/132-enp0s29f1:rx-022:55:110
1315551991614,1cyclictest60350irq/132-enp0s29f1:rx-022:05:170
1315551991613,2cyclictest60350irq/132-enp0s29f1:rx-023:04:220
1315551991613,2cyclictest60350irq/132-enp0s29f1:rx-019:45:120
1315551991613,2cyclictest60350irq/132-enp0s29f1:rx-000:00:180
1315551991613,2cyclictest1403785-21kworker/u8:0+flush-259:021:25:190
1315551991612,3cyclictest1523013-21ntp_kernel_pll_22:25:220
1315561991510,3cyclictest1320585-21kworker/u8:0+flush-259:019:20:173
1315558991513,1cyclictest0-21swapper/223:05:002
1315558991512,2cyclictest1539315-21kworker/u8:0+flush-259:022:55:162
1315558991511,3cyclictest1450236-21kworker/u8:3+events_unbound22:25:232
131555899150,13cyclictest1-21systemd20:15:332
131555699159,4cyclictest1585863-21/usr/sbin/munin23:30:211
131555699153,3cyclictest1536221-21cut22:40:201
1315556991511,3cyclictest1653294-21kworker/u8:1+flush-259:000:38:391
131555699150,3cyclictest1434885-21cat21:04:591
1315551991514,1cyclictest60350irq/132-enp0s29f1:rx-021:45:420
1315551991514,1cyclictest60350irq/132-enp0s29f1:rx-020:23:270
1315551991513,2cyclictest60350irq/132-enp0s29f1:rx-020:15:570
1315551991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:230
1315551991513,1cyclictest60350irq/132-enp0s29f1:rx-021:20:260
1315551991513,1cyclictest60350irq/132-enp0s29f1:rx-021:00:230
1315551991513,1cyclictest60350irq/132-enp0s29f1:rx-020:00:180
1315551991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:240
1315551991513,1cyclictest1341238-21fwupd19:34:560
1315551991511,3cyclictest1450236-21kworker/u8:3+events_unbound22:40:180
1315551991511,3cyclictest1403785-21kworker/u8:0+flush-259:022:00:200
131556199148,4cyclictest252-21systemd-journal23:29:593
1315561991411,2cyclictest1331289-21cpuspeed_turbos19:25:133
1315561991410,2cyclictest0-21swapper/300:05:003
131555899149,3cyclictest1621746-21apt-get00:05:022
131555899149,3cyclictest1621746-21apt-get00:05:022
131555899149,3cyclictest1341509-21/usr/sbin/munin19:35:162
131555899148,4cyclictest1482515-21cat21:50:012
1315558991411,2cyclictest1545719-21kthreadcore22:50:172
1315558991411,2cyclictest1367575-21kworker/u8:4+flush-259:020:10:182
1315558991410,3cyclictest252-21systemd-journal20:54:552
131555699144,2cyclictest0-21swapper/120:15:181
1315556991411,2cyclictest2971-21cron21:00:001
1315556991411,2cyclictest1345627-21ntp_offset19:35:221
131555699140,5cyclictest1611412-21cron23:55:001
131555699140,4cyclictest1529047-21systemd-run22:35:011
1315551991412,1cyclictest60350irq/132-enp0s29f1:rx-023:45:250
1315551991412,1cyclictest60350irq/132-enp0s29f1:rx-023:15:250
1315551991411,2cyclictest60350irq/132-enp0s29f1:rx-019:35:210
1315551991410,3cyclictest1394022-21kworker/u8:2+events_unbound20:25:220
131556199139,3cyclictest252-21systemd-journal23:44:553
131556199137,4cyclictest1544432-21latency_hist22:50:013
1315561991311,1cyclictest1580479-21cron23:24:593
1315561991310,1cyclictest0-21swapper/321:09:593
1315561991310,1cyclictest0-21swapper/320:00:253
131555899139,3cyclictest1492658-21kworker/u8:1+flush-259:023:05:262
131555899139,2cyclictest0-21swapper/220:35:012
131555899131,9cyclictest1419240-21awk20:50:012
131555699130,5cyclictest1491791-21ntpq21:55:211
131555699130,4cyclictest1498199-21tr22:05:141
131555199138,4cyclictest1315781-21apt-get19:10:130
1315551991312,1cyclictest61150irq/133-enp0s29f1:tx-020:10:170
1315551991311,2cyclictest61150irq/133-enp0s29f1:tx-022:45:250
1315551991311,1cyclictest60350irq/132-enp0s29f1:rx-019:20:150
1315551991310,2cyclictest1565457-21fschecks_count23:10:140
131556199129,2cyclictest1626802-21unixbench_multi00:05:253
131556199129,2cyclictest1626802-21unixbench_multi00:05:253
131556199129,1cyclictest0-21swapper/320:55:003
131556199128,3cyclictest1403785-21kworker/u8:0+flush-259:020:40:213
131556199128,3cyclictest1283385-21kworker/u8:1+flush-259:019:30:233
131556199127,4cyclictest1534128-21sshd22:39:333
1315561991210,1cyclictest0-21swapper/320:30:003
131556199120,3cyclictest13236201kthreadcore19:15:193
131555899129,2cyclictest1409622-21irqcore20:40:162
131555899126,4cyclictest252-21systemd-journal23:45:002
1315558991210,1cyclictest0-21swapper/221:20:262
131555699128,3cyclictest1444512-21kworker/u8:2+flush-259:021:13:381
1315556991210,1cyclictest0-21swapper/123:00:191
1315556991210,1cyclictest0-21swapper/120:09:591
1315551991210,1cyclictest60350irq/132-enp0s29f1:rx-022:30:270
131556199111,8cyclictest1-21systemd00:24:333
131556199110,3cyclictest1658231-21latency_hist00:40:003
131555899110,2cyclictest1492658-21kworker/u8:1+flush-259:022:35:002
131555699117,3cyclictest1632685-21apt-get00:15:111
131555699117,3cyclictest1403785-21kworker/u8:0+flush-259:021:09:061
131555699115,4cyclictest1398841-21awk20:30:121
131556199107,2cyclictest1652587-21unixbench_singl00:30:253
131556199107,2cyclictest0-21swapper/323:35:253
131555699108,1cyclictest0-21swapper/119:45:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional