You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 07:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Mar 19, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1278969994442,1cyclictest1305375-21fwupd19:33:202
1278969994035,4cyclictest1518990-21kworker/u8:1+flush-259:023:20:162
1278973993834,3cyclictest1508705-21kworker/u8:0+flush-259:022:50:153
1278966993734,2cyclictest1289308-21kworker/u8:0+flush-259:019:45:231
1278963993732,4cyclictest1310722-21latency_hist19:40:010
1278973993630,4cyclictest252-21systemd-journal00:27:363
1278966993633,2cyclictest1440804-21kworker/u8:0+flush-259:022:05:241
1278966993630,3cyclictest1419995-21kworker/u8:2+flush-259:021:30:151
1278963993633,2cyclictest1518990-21kworker/u8:1+flush-259:023:15:150
1278963993632,3cyclictest1446444-21apt-get21:50:110
1278969993529,4cyclictest1607809-21/usr/sbin/munin00:25:132
1278966993529,4cyclictest252-21systemd-journal19:25:031
1278963993529,4cyclictest1452145-21diskstats21:55:120
1278966993431,2cyclictest1539462-21kworker/u8:2+events_unbound00:00:151
1278966993430,3cyclictest1289308-21kworker/u8:0+flush-259:019:55:201
1278966993428,4cyclictest509-21rs:main1
1278963993431,2cyclictest1440804-21kworker/u8:0+events_unbound22:05:130
1278966993229,2cyclictest1394039-21kworker/u8:1+events_unbound21:10:151
1278966993227,3cyclictest1451985-21apt-get21:55:111
1278969993126,3cyclictest1294574-21base6419:25:002
1278966993126,3cyclictest1305386-21kworker/u8:3+flush-259:021:25:121
1278973993023,5cyclictest1399283-21latency_hist21:05:013
1278966993025,3cyclictest1357850-21kworker/u8:2+flush-259:020:55:231
1278963993027,2cyclictest1539462-21kworker/u8:2+flush-259:023:45:150
1278973992925,3cyclictest1570312-21kworker/u8:3+flush-259:000:10:153
1278973992923,4cyclictest1321446-21latency_hist19:50:013
1278966992926,2cyclictest1518990-21kworker/u8:1+events_unbound23:05:121
1278966992925,3cyclictest1518990-21kworker/u8:1+flush-259:023:00:211
1278966992925,3cyclictest1440804-21kworker/u8:0+events_unbound22:15:121
1278966992925,3cyclictest1220723-21kworker/u8:1+flush-259:019:10:111
1278963992926,2cyclictest1305386-21kworker/u8:3+events_unbound20:20:140
1278963992926,2cyclictest1220723-21kworker/u8:1+events_unbound19:45:140
1278973992823,3cyclictest1300068-21cp19:30:013
1278973992822,4cyclictest1342507-21latency_hist20:10:013
1278966992825,2cyclictest1220723-21kworker/u8:1+events_unbound19:30:121
1278966992824,3cyclictest1289308-21kworker/u8:0+events_unbound19:40:141
1278966992823,3cyclictest1347729-21kworker/u8:0+flush-259:020:25:221
1278963992821,5cyclictest1502688-21ntpq22:40:200
1278969992722,3cyclictest509-21rs:main2
1278966992724,2cyclictest1440804-21kworker/u8:0+flush-259:022:20:221
1278966992723,3cyclictest1440804-21kworker/u8:0+flush-259:022:25:211
1278963992724,2cyclictest1440804-21kworker/u8:0+flush-259:022:25:000
1278969992622,3cyclictest1539462-21kworker/u8:2+events_unbound00:20:132
1278969992621,3cyclictest1518990-21kworker/u8:1+events_unbound23:15:162
1278966992622,3cyclictest1570312-21kworker/u8:3+flush-259:000:15:041
1278966992622,3cyclictest1278525-21kworker/u8:2+flush-259:019:15:271
1278966992620,4cyclictest252-21systemd-journal21:19:361
1278963992622,3cyclictest1394039-21kworker/u8:1+flush-259:021:20:170
1278963992620,4cyclictest1440571-21apt-get21:45:000
1278973992519,4cyclictest1352832-21latency_hist20:20:003
1278973992518,4cyclictest1337379-21latency_hist20:05:003
1278969992522,2cyclictest1483003-21turbostat22:25:002
1278966992522,2cyclictest1508705-21kworker/u8:0+events_unbound22:50:141
1278963992521,3cyclictest1289308-21kworker/u8:0+flush-259:019:25:240
1278963992518,5cyclictest1408705-21ntpq21:10:210
1278969992420,3cyclictest1518990-21kworker/u8:1+flush-259:023:10:162
1278969992420,3cyclictest1357850-21kworker/u8:2+events_unbound20:35:132
1278966992421,2cyclictest1518990-21kworker/u8:1+events_unbound23:15:201
1278966992420,3cyclictest1544869-21kworker/u8:0+flush-259:023:50:001
1278963992422,1cyclictest130-1kworker/0:1H+kblockd19:33:210
1278963992420,3cyclictest1570312-21kworker/u8:3+flush-259:000:35:170
1278963992420,3cyclictest1278525-21kworker/u8:2+events_unbound19:15:150
1278966992320,2cyclictest1539462-21kworker/u8:2+flush-259:000:30:241
1278966992319,3cyclictest1363425-21apt-get20:30:091
1278966992319,3cyclictest1363425-21apt-get20:30:091
1278966992319,3cyclictest1220723-21kworker/u8:1+events_unbound19:50:151
1278963992320,2cyclictest1289308-21kworker/u8:0+flush-259:019:55:150
1278963992319,3cyclictest1378910-21apt-get20:45:100
1278969992219,2cyclictest1472435-21gpgv22:15:002
1278966992219,2cyclictest1488133-21kworker/u8:2+events_unbound22:40:131
1278966992219,2cyclictest1394039-21kworker/u8:1+flush-259:021:35:221
1278966992217,3cyclictest252-21systemd-journal22:34:361
1278966992217,3cyclictest1618157-21/usr/sbin/munin00:35:151
1278966992216,4cyclictest1574985-21ntpq23:50:201
1278963992218,3cyclictest1586384-21apt-get00:05:090
1278963992218,3cyclictest1451341-21kworker/u8:3+flush-259:022:30:170
1278963992218,3cyclictest1220723-21kworker/u8:1+flush-259:019:50:160
1278973992118,1cyclictest0-21swapper/320:00:003
1278969992118,2cyclictest1357850-21kworker/u8:2+flush-259:020:30:182
1278969992118,2cyclictest1357850-21kworker/u8:2+flush-259:020:30:182
1278966992118,2cyclictest1440804-21kworker/u8:0+events_unbound22:10:201
1278966992118,2cyclictest1419995-21kworker/u8:2+events_unbound21:45:151
1278966992118,2cyclictest1394039-21kworker/u8:1+events_unbound21:20:161
1278966992117,3cyclictest1539462-21kworker/u8:2+events_unbound23:30:271
1278966992117,3cyclictest1488133-21kworker/u8:2+events_unbound22:45:421
1278966992117,3cyclictest1440804-21kworker/u8:0+events_unbound21:50:261
1278963992118,2cyclictest1419995-21kworker/u8:2+events_unbound21:30:140
1278963992117,3cyclictest1602405-21cat00:20:000
1278973992016,3cyclictest1467205-21kworker/u8:1+flush-259:022:25:263
1278973992015,3cyclictest1596937-21base6400:15:013
1278969992017,2cyclictest1467205-21kworker/u8:1+events_unbound22:25:162
1278969992017,2cyclictest1331890-21gpgv20:00:002
1278969992016,3cyclictest1394039-21kworker/u8:1+flush-259:021:15:012
127896999200,18cyclictest1-21systemd22:10:002
1278966992017,2cyclictest1539462-21kworker/u8:2+flush-259:023:25:211
1278966992017,2cyclictest1451341-21kworker/u8:3+events_unbound22:35:131
1278966992016,3cyclictest1518990-21kworker/u8:1+flush-259:023:10:241
1278966992016,3cyclictest1518990-21kworker/u8:1+events_unbound23:23:381
1278966992016,3cyclictest1419995-21kworker/u8:2+flush-259:021:40:271
1278963992014,4cyclictest252-21systemd-journal19:24:560
1278973991914,3cyclictest1284393-21apt-get19:15:123
1278973991912,5cyclictest252-21systemd-journal00:05:373
1278969991916,2cyclictest1462039-21idleruntime-cro22:04:592
1278969991916,2cyclictest1440804-21kworker/u8:0+flush-259:021:50:232
1278969991915,3cyclictest509-21rs:main2
1278969991915,3cyclictest1539462-21kworker/u8:2+events_unbound23:55:232
1278966991915,3cyclictest1419995-21kworker/u8:2+events_unbound22:00:101
1278966991912,5cyclictest1403608-21ntpq21:05:221
1278963991918,1cyclictest1570312-21kworker/u8:3+events_unbound00:30:140
1278963991915,3cyclictest1451341-21kworker/u8:3+events_unbound22:35:150
1278973991816,1cyclictest1294431-21idleruntime-cro19:25:003
1278973991814,2cyclictest1544849-21sh23:25:003
1278973991812,4cyclictest1478122-21/usr/sbin/munin22:20:213
1278973991811,5cyclictest252-21systemd-journal19:13:363
1278969991815,2cyclictest1305386-21kworker/u8:3+events_unbound21:00:142
1278969991814,3cyclictest1305386-21kworker/u8:3+events_unbound20:00:212
1278969991814,2cyclictest1363178-21munin-plugin-st20:29:592
1278966991815,2cyclictest1539462-21kworker/u8:2+events_unbound23:35:161
1278966991815,2cyclictest1357850-21kworker/u8:2+flush-259:020:35:151
1278966991814,3cyclictest1347729-21kworker/u8:0+events_unbound20:45:161
1278966991814,2cyclictest1357850-21kworker/u8:2+flush-259:020:45:001
1278963991815,2cyclictest1570312-21kworker/u8:3+flush-259:000:10:160
1278963991815,2cyclictest1467205-21kworker/u8:1+flush-259:022:45:270
1278963991814,3cyclictest1394039-21kworker/u8:1+flush-259:021:35:170
1278963991814,3cyclictest1347729-21kworker/u8:0+events_unbound20:30:180
1278963991814,3cyclictest1347729-21kworker/u8:0+events_unbound20:30:170
1278973991714,2cyclictest1498408-21idleruntime-cro22:40:003
1278973991711,4cyclictest1514108-21/usr/sbin/munin22:55:133
127896999175,11cyclictest1388798-21sshd20:53:362
1278969991714,2cyclictest1570312-21kworker/u8:3+flush-259:000:05:172
1278969991714,2cyclictest1508705-21kworker/u8:0+flush-259:022:55:212
1278969991713,3cyclictest1220723-21kworker/u8:1+flush-259:020:15:202
1278966991715,2cyclictest1305386-21kworker/u8:3+events_unbound20:06:391
1278966991714,2cyclictest1508705-21kworker/u8:0+events_unbound22:58:381
1278966991714,2cyclictest1289308-21kworker/u8:0+flush-259:019:35:061
1278966991712,3cyclictest1539462-21kworker/u8:2+events_unbound23:40:181
1278963991714,2cyclictest60350irq/132-enp0s29f1:rx-023:50:160
1278963991714,2cyclictest1305386-21kworker/u8:3+events_unbound20:10:130
1278963991713,3cyclictest1539462-21kworker/u8:2+flush-259:023:55:180
1278963991713,3cyclictest1539462-21kworker/u8:2+events_unbound23:40:220
1278963991713,3cyclictest1420233-21apt-get21:25:090
1278963991713,3cyclictest1373732-21apt-get20:40:090
1278963991713,3cyclictest1305386-21kworker/u8:3+events_unbound21:15:120
1278973991613,2cyclictest1419995-21kworker/u8:2+flush-259:021:40:133
1278973991612,2cyclictest0-21swapper/323:05:003
1278973991610,4cyclictest1529645-21apt-get23:10:113
1278973991610,4cyclictest1472832-21base6422:15:003
1278969991613,2cyclictest1570312-21kworker/u8:3+flush-259:000:35:162
1278969991613,2cyclictest1518990-21kworker/u8:1+flush-259:023:00:162
1278969991613,2cyclictest1508705-21kworker/u8:0+flush-259:023:05:232
1278969991613,2cyclictest1417374-21kthreadcore21:20:182
1278969991612,3cyclictest1220723-21kworker/u8:1+flush-259:019:50:182
1278966991613,2cyclictest1357850-21kworker/u8:2+events_unbound20:50:211
1278966991612,3cyclictest1570312-21kworker/u8:3+flush-259:000:10:221
1278966991611,3cyclictest1353097-21apt-get20:20:111
1278963991614,1cyclictest60350irq/132-enp0s29f1:rx-023:05:240
1278963991614,1cyclictest60350irq/132-enp0s29f1:rx-020:00:180
1278963991613,2cyclictest1518990-21kworker/u8:1+flush-259:023:10:190
1278963991613,2cyclictest1220723-21kworker/u8:1+events_unbound19:10:200
1278963991612,3cyclictest1508950-21apt-get22:50:100
1278963991612,3cyclictest1419995-21kworker/u8:2+events_unbound22:00:210
127897399159,4cyclictest1555196-21latency_hist23:35:013
1278973991512,2cyclictest0-21swapper/323:30:003
127897399151,12cyclictest1377675-21needreboot20:40:163
127896999158,5cyclictest1441210-21cp21:45:012
1278969991513,1cyclictest1321456-21idleruntime-cro19:49:592
1278969991513,1cyclictest0-21swapper/223:30:002
1278969991512,3cyclictest1539462-21kworker/u8:2+events_unbound23:35:182
1278969991512,2cyclictest1488133-21kworker/u8:2+flush-259:022:50:002
1278969991512,2cyclictest1284124-21idleruntime-cro19:15:012
1278969991512,2cyclictest1220723-21kworker/u8:1+flush-259:020:10:212
1278969991511,3cyclictest1539462-21kworker/u8:2+events_unbound00:15:232
1278969991511,3cyclictest1413913-21ntp_kernel_pll_21:15:202
1278969991511,3cyclictest1394039-21kworker/u8:1+flush-259:021:35:002
1278966991511,3cyclictest1539462-21kworker/u8:2+flush-259:000:25:151
1278963991513,2cyclictest60350irq/132-enp0s29f1:rx-023:32:030
1278963991513,2cyclictest1539462-21kworker/u8:2+events_unbound00:00:260
1278963991513,2cyclictest1518990-21kworker/u8:1+events_unbound23:00:230
1278963991513,2cyclictest1440804-21kworker/u8:0+events_unbound22:15:200
1278963991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:240
1278963991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:140
1278963991512,3cyclictest1419995-21kworker/u8:2+flush-259:021:45:250
1278963991512,2cyclictest60350irq/132-enp0s29f1:rx-021:05:120
1278963991512,2cyclictest60350irq/132-enp0s29f1:rx-020:25:110
1278963991512,2cyclictest1539462-21kworker/u8:2+events_unbound23:35:260
1278963991512,2cyclictest1399290-21turbostat21:04:590
1278963991512,2cyclictest1289308-21kworker/u8:0+events_unbound19:40:150
1278963991510,4cyclictest1384063-21apt-get20:50:120
127897399149,3cyclictest1440804-21kworker/u8:0+flush-259:022:05:253
127897399149,3cyclictest1357850-21kworker/u8:2+flush-259:020:55:263
1278973991412,1cyclictest0-21swapper/323:45:003
1278973991411,1cyclictest0-21swapper/319:50:193
1278973991410,3cyclictest1488133-21kworker/u8:2+flush-259:022:45:203
1278969991412,1cyclictest0-21swapper/221:45:012
1278969991411,2cyclictest1488133-21kworker/u8:2+events_unbound22:40:192
1278969991411,2cyclictest1451341-21kworker/u8:3+flush-259:022:35:152
1278969991410,3cyclictest1596421-21apt-get00:15:012
1278969991410,3cyclictest1394039-21kworker/u8:1+flush-259:021:35:282
1278969991410,3cyclictest1357850-21kworker/u8:2+flush-259:020:55:212
127896999140,12cyclictest1-21systemd21:30:012
1278966991412,1cyclictest0-21swapper/121:04:591
1278966991411,2cyclictest1570312-21kworker/u8:3+events_unbound00:23:371
1278966991411,2cyclictest1305386-21kworker/u8:3+flush-259:020:10:251
1278963991411,2cyclictest60350irq/132-enp0s29f1:rx-023:25:210
1278963991411,2cyclictest60350irq/132-enp0s29f1:rx-020:35:130
1278963991411,2cyclictest1220723-21kworker/u8:1+flush-259:020:05:210
1278963991410,3cyclictest60350irq/132-enp0s29f1:rx-022:55:120
127897399139,3cyclictest1492377-21ntp_kernel_pll_22:30:193
127897399139,3cyclictest1357850-21kworker/u8:2+flush-259:020:33:413
127897399139,3cyclictest1357850-21kworker/u8:2+flush-259:020:33:403
127897399139,2cyclictest0-21swapper/319:45:003
127897399137,4cyclictest252-21systemd-journal23:35:593
127897399136,5cyclictest252-21systemd-journal23:20:003
127897399136,4cyclictest1467205-21kworker/u8:1+flush-259:022:10:163
1278973991311,1cyclictest0-21swapper/321:55:013
127896999139,3cyclictest1539462-21kworker/u8:2+flush-259:023:50:182
127896999139,3cyclictest1539462-21kworker/u8:2+flush-259:000:00:172
127896999139,3cyclictest1347729-21kworker/u8:0+events_unbound20:40:192
1278969991310,2cyclictest1451341-21kworker/u8:3+flush-259:022:50:232
1278969991310,2cyclictest1440804-21kworker/u8:0+flush-259:022:15:182
1278969991310,2cyclictest1399804-21fschecks_time21:05:142
127896699139,3cyclictest1305386-21kworker/u8:3+events_unbound20:00:191
127896699130,3cyclictest1580997-21awk00:00:001
127896399139,3cyclictest1539462-21kworker/u8:2+events_unbound00:25:200
127896399139,3cyclictest1518990-21kworker/u8:1+events_unbound23:25:010
1278963991311,1cyclictest60350irq/132-enp0s29f1:rx-022:29:380
1278963991311,1cyclictest60350irq/132-enp0s29f1:rx-020:55:250
1278963991311,1cyclictest60350irq/132-enp0s29f1:rx-000:20:150
127897399129,2cyclictest1384129-21cpuspeed_turbos20:50:123
1278969991210,1cyclictest0-21swapper/219:39:592
127896699129,1cyclictest0-21swapper/100:05:201
127897399118,2cyclictest491ktimers/320:45:213
127897399117,3cyclictest1310015-21sensors_temp19:35:223
127897399117,2cyclictest0-21swapper/323:05:183
127896999118,2cyclictest1566037-21fschecks_time23:45:132
127896999118,1cyclictest0-21swapper/219:45:002
127896999106,3cyclictest1550264-21kworker/u8:3+flush-259:023:30:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional