You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 10:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Sep 20, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1247054995550,3cyclictest1377440-21kworker/u8:3+events_unbound21:30:001
1247051995144,5cyclictest1367466-21latency_hist21:05:010
1247051995045,4cyclictest1241563-21kworker/u8:1+flush-259:020:50:240
1247054994743,3cyclictest1466235-21kworker/u8:0+flush-259:023:05:261
1247051994542,2cyclictest1377440-21kworker/u8:3+flush-259:023:15:250
1247058994235,5cyclictest1518792-21latency_hist23:30:012
1247054994238,3cyclictest1267682-21kworker/u8:2+events_unbound19:45:241
1247062994135,4cyclictest1545031-21latency_hist23:55:013
1247058994031,6cyclictest1524132-21cp23:35:012
1247054994036,3cyclictest1241563-21kworker/u8:1+flush-259:019:55:281
1247054993835,2cyclictest1252173-21kworker/u8:4+flush-259:019:15:261
1247054993835,2cyclictest1252173-21kworker/u8:4+flush-259:019:15:251
1247051993834,3cyclictest1377440-21kworker/u8:3+flush-259:021:15:270
1247062993730,5cyclictest1299918-21cat20:00:023
1247054993734,2cyclictest1241563-21kworker/u8:1+flush-259:020:00:151
1247054993634,1cyclictest1441018-21kworker/u8:1+flush-259:022:35:251
1247051993633,2cyclictest1252173-21kworker/u8:4+flush-259:019:30:250
1247062993530,3cyclictest1493139-21/usr/sbin/munin23:05:243
1247062993530,3cyclictest1341873-21apt-get20:40:123
1247058993530,4cyclictest1466638-21gpgv22:40:002
1247054993532,2cyclictest1398730-21kworker/u8:2+flush-259:021:55:161
1247051993529,4cyclictest1424978-21cat22:00:010
1247051993528,5cyclictest335557-21systemd-journal22:40:010
1247058993428,4cyclictest1299290-21latency_hist20:00:012
1247058993427,5cyclictest1251249-21ntpq19:10:252
1247054993430,3cyclictest1362532-21apt-get21:00:131
1247054993330,2cyclictest1377440-21kworker/u8:3+events_unbound22:40:281
1247054993329,3cyclictest1398730-21kworker/u8:2+flush-259:021:35:251
1247054993328,4cyclictest1576080-21latency_hist00:25:001
1247051993328,3cyclictest1241563-21kworker/u8:1+flush-259:021:00:000
1247062993225,5cyclictest1591229-21ntpq00:35:243
1247062993127,3cyclictest1414465-21kworker/u8:4+flush-259:000:15:263
1247062993125,4cyclictest1545263-21kworker/u8:3+flush-259:000:20:253
1247062993025,3cyclictest1377440-21kworker/u8:3+events_unbound23:25:143
1247058993023,5cyclictest1420079-21diskstats21:55:152
1247054993027,2cyclictest1404162-21kworker/u8:1+events_unbound21:40:201
1247054993027,2cyclictest1377440-21kworker/u8:3+flush-259:022:30:231
1247054993026,3cyclictest1513897-21apt-get23:25:111
1247054993026,3cyclictest1414465-21kworker/u8:4+flush-259:023:45:181
1247054993025,4cyclictest1566014-21apt-get00:15:141
1247051993024,4cyclictest1486865-21ntpq22:55:220
1247054992926,2cyclictest1570646-21kworker/u8:0+flush-259:000:25:141
1247054992926,2cyclictest1523567-21kworker/u8:1+flush-259:023:55:161
1247054992926,2cyclictest1320829-21kworker/u8:2+events_unbound20:55:001
1247051992925,3cyclictest1545263-21kworker/u8:3+events_unbound23:55:240
1247051992923,4cyclictest1336675-21apt-get20:35:130
1247062992824,3cyclictest1377440-21kworker/u8:3+flush-259:021:15:203
1247058992822,4cyclictest1425434-21cat22:00:022
124705899280,26cyclictest1-21systemd23:15:002
1247054992826,1cyclictest1377440-21kworker/u8:3+flush-259:022:00:201
1247054992825,2cyclictest1414465-21kworker/u8:4+flush-259:022:20:191
1247054992825,2cyclictest1404162-21kworker/u8:1+events_unbound21:45:131
1247054992825,2cyclictest1320829-21kworker/u8:2+events_unbound20:25:191
1247054992823,4cyclictest335557-21systemd-journal21:08:241
1247051992825,2cyclictest1466235-21kworker/u8:0+flush-259:023:30:160
1247062992720,5cyclictest1272887-21latency_hist19:35:003
1247058992720,5cyclictest335557-21systemd-journal00:19:242
1247054992724,2cyclictest1570646-21kworker/u8:0+flush-259:000:35:261
1247054992724,2cyclictest1414465-21kworker/u8:4+flush-259:022:10:201
1247051992723,3cyclictest1466235-21kworker/u8:0+events_unbound22:50:190
1247051992723,3cyclictest1362495-21kworker/u8:0+events_unbound21:10:170
1247051992723,3cyclictest1267682-21kworker/u8:2+flush-259:019:35:250
1247062992622,3cyclictest1414465-21kworker/u8:4+flush-259:022:10:213
1247062992619,5cyclictest1278112-21latency_hist19:40:003
1247058992620,4cyclictest1331449-21/usr/sbin/munin20:30:152
1247054992623,2cyclictest1466235-21kworker/u8:0+flush-259:023:20:001
1247054992623,2cyclictest1377440-21kworker/u8:3+events_unbound22:55:231
1247054992623,2cyclictest1320829-21kworker/u8:2+events_unbound20:30:201
1247054992623,2cyclictest1252173-21kworker/u8:4+flush-259:019:35:151
1247054992622,3cyclictest1414465-21kworker/u8:4+flush-259:000:00:161
1247054992622,3cyclictest1393926-21cat21:30:011
1247054992622,3cyclictest1393926-21cat21:30:001
1247051992622,3cyclictest1570646-21kworker/u8:0+flush-259:000:20:150
1247051992622,3cyclictest1466235-21kworker/u8:0+events_unbound23:27:300
1247051992622,3cyclictest1320829-21kworker/u8:2+events_unbound20:30:140
1247051992622,3cyclictest1299408-21gpgv20:00:010
1247062992519,4cyclictest1289116-21cat19:50:013
1247058992519,5cyclictest509-21rs:main2
1247058992518,5cyclictest1346783-21latency_hist20:45:012
1247054992522,2cyclictest1545263-21kworker/u8:3+events_unbound00:10:231
1247054992522,2cyclictest1466235-21kworker/u8:0+events_unbound23:20:131
1247054992522,2cyclictest1425463-21kworker/u8:1+flush-259:022:05:251
1247054992522,2cyclictest1252173-21kworker/u8:4+flush-259:019:30:201
1247054992521,3cyclictest1377440-21kworker/u8:3+flush-259:021:50:151
1247054992521,2cyclictest1304643-21kworker/u8:4+flush-259:020:05:211
1247051992521,3cyclictest1472442-21kworker/u8:1+events_unbound22:45:250
1247051992521,3cyclictest1304540-21kworker/u8:3+events_unbound20:04:250
1247051992521,3cyclictest1267682-21kworker/u8:2+events_unbound19:44:270
1247051992520,3cyclictest1545263-21kworker/u8:3+events_unbound00:28:260
1247062992421,2cyclictest1441018-21kworker/u8:1+flush-259:022:30:183
124706299241,21cyclictest1-21systemd19:41:243
1247058992420,3cyclictest1425463-21kworker/u8:1+flush-259:022:05:242
1247058992417,5cyclictest335557-21systemd-journal20:54:592
1247054992421,2cyclictest1570646-21kworker/u8:0+flush-259:000:30:211
1247054992421,2cyclictest1466235-21kworker/u8:0+flush-259:023:30:211
1247054992421,2cyclictest1362495-21kworker/u8:0+events_unbound21:10:211
1247054992421,2cyclictest1321039-21kworker/u8:4+events_unbound20:21:241
1247054992420,3cyclictest1310735-21apt-get20:10:121
1247051992421,2cyclictest1425463-21kworker/u8:1+flush-259:022:05:230
1247051992420,3cyclictest1414465-21kworker/u8:4+events_unbound23:10:000
1247062992318,3cyclictest1414465-21kworker/u8:4+flush-259:022:15:173
1247062992317,4cyclictest509-21rs:main3
1247062992317,4cyclictest1320829-21kworker/u8:2+flush-259:020:20:203
1247054992320,2cyclictest1441051-21apt-get22:15:111
1247054992320,2cyclictest1320829-21kworker/u8:2+events_unbound20:57:061
1247054992320,2cyclictest1252173-21kworker/u8:4+flush-259:019:40:181
1247054992315,6cyclictest335557-21systemd-journal21:18:241
1247051992319,3cyclictest1320829-21kworker/u8:2+flush-259:020:45:240
1247051992318,4cyclictest1555623-21kworker/u8:0+flush-259:000:05:150
1247062992215,5cyclictest1331215-21latency_hist20:30:013
1247062992214,6cyclictest1492899-21latency_hist23:04:593
1247058992216,4cyclictest1310048-21apt-get20:10:022
1247054992219,2cyclictest1414465-21kworker/u8:4+events_unbound23:35:181
1247051992219,2cyclictest1388132-21kworker/u8:1+events_unbound21:29:240
1247051992218,3cyclictest1414465-21kworker/u8:4+flush-259:022:12:220
1247051992218,3cyclictest1377440-21kworker/u8:3+events_unbound22:40:230
1247051992216,4cyclictest335557-21systemd-journal23:14:230
1247062992118,2cyclictest1414465-21kworker/u8:4+flush-259:023:35:243
1247062992118,2cyclictest1414465-21kworker/u8:4+events_unbound23:45:143
1247062992117,3cyclictest1310072-21kworker/u8:0+flush-259:020:15:223
1247062992116,4cyclictest1371783-21kworker/u8:1+flush-259:021:15:003
1247054992118,2cyclictest1523567-21kworker/u8:1+events_unbound23:40:261
1247054992118,2cyclictest1377440-21kworker/u8:3+flush-259:022:45:151
1247054992118,2cyclictest1320829-21kworker/u8:2+flush-259:020:35:221
1247054992115,4cyclictest1540116-21/usr/sbin/munin23:50:141
1247051992117,3cyclictest1414465-21kworker/u8:4+events_unbound22:15:220
1247051992117,3cyclictest1252173-21kworker/u8:4+flush-259:019:25:210
1247051992116,3cyclictest1414465-21kworker/u8:4+flush-259:000:02:410
1247062992017,2cyclictest1377440-21kworker/u8:3+events_unbound22:55:263
1247062992016,3cyclictest1441018-21kworker/u8:1+flush-259:022:25:243
1247062992016,3cyclictest1320829-21kworker/u8:2+events_unbound20:50:153
1247062992014,4cyclictest1576508-21diskstats00:25:153
1247062992014,4cyclictest1377440-21kworker/u8:3+flush-259:023:25:003
1247058992015,4cyclictest1320829-21kworker/u8:2+flush-259:021:00:002
1247058992014,4cyclictest1445945-21latency_hist22:20:012
1247054992017,2cyclictest1226732-21kworker/u8:3+events_unbound19:29:251
1247054992016,3cyclictest1466235-21kworker/u8:0+events_unbound22:52:281
1247051992017,2cyclictest1461470-21idleruntime-cro22:35:000
1247051992017,2cyclictest1241563-21kworker/u8:1+flush-259:019:20:150
1247051992016,3cyclictest1466235-21kworker/u8:0+events_unbound23:21:260
1247051992016,3cyclictest1414465-21kworker/u8:4+events_unbound23:42:340
1247051992016,3cyclictest1398730-21kworker/u8:2+flush-259:021:45:230
1247051992016,3cyclictest1267682-21kworker/u8:2+flush-259:019:50:150
1247051992016,2cyclictest1320829-21kworker/u8:2+events_unbound20:20:220
1247062991916,2cyclictest1545263-21kworker/u8:3+flush-259:000:05:163
1247062991913,4cyclictest335557-21systemd-journal23:32:233
124705899196,8cyclictest1586881-21apt00:35:002
1247058991915,3cyclictest1388132-21kworker/u8:1+flush-259:021:25:172
1247058991913,4cyclictest1477390-21latency_hist22:50:002
1247054991916,2cyclictest1545263-21kworker/u8:3+flush-259:000:07:391
1247054991916,2cyclictest1226732-21kworker/u8:3+events_unbound19:10:261
1247054991914,4cyclictest1492922-21kworker/u8:1+flush-259:023:04:591
1247054991912,5cyclictest335557-21systemd-journal21:20:251
1247054991912,5cyclictest1262506-21latency_hist19:25:001
1247051991915,3cyclictest1404162-21kworker/u8:1+events_unbound21:40:220
1247051991915,3cyclictest1362495-21kworker/u8:0+flush-259:021:05:220
1247051991914,4cyclictest509-21rs:main0
1247051991914,4cyclictest509-21rs:main0
1247051991913,4cyclictest1455393-21ntpq22:25:200
1247062991815,1cyclictest0-21swapper/321:50:013
1247062991815,1cyclictest0-21swapper/319:50:003
1247062991814,3cyclictest335557-21systemd-journal23:19:593
1247062991814,3cyclictest1466235-21kworker/u8:0+flush-259:023:10:263
1247062991814,3cyclictest1398730-21kworker/u8:2+flush-259:021:45:003
1247058991815,2cyclictest1450289-21ntp_kernel_pll_22:20:212
1247058991815,2cyclictest1414465-21kworker/u8:4+flush-259:023:47:302
1247058991813,4cyclictest1267682-21kworker/u8:2+flush-259:019:51:072
1247058991813,3cyclictest1283511-21/usr/sbin/munin19:45:232
1247058991812,4cyclictest1372597-21latency_hist21:10:012
1247054991815,2cyclictest1441018-21kworker/u8:1+events_unbound22:25:211
1247051991815,2cyclictest1565445-21kworker/u8:1+flush-259:000:30:250
1247051991815,2cyclictest1414465-21kworker/u8:4+events_unbound22:22:260
1247051991812,4cyclictest335557-21systemd-journal23:05:000
1247062991715,1cyclictest0-21swapper/320:10:003
1247062991713,3cyclictest1320829-21kworker/u8:2+flush-259:021:00:263
1247062991713,3cyclictest1267682-21kworker/u8:2+flush-259:019:55:243
1247062991711,4cyclictest1450325-21ntpq22:20:223
1247062991710,5cyclictest1586877-21latency_hist00:35:013
1247058991714,2cyclictest1545030-21idleruntime-cro23:55:002
1247058991714,2cyclictest1406727-21kthreadcore21:40:192
1247058991714,1cyclictest0-21swapper/223:04:592
1247058991712,4cyclictest1320829-21kworker/u8:2+flush-259:020:45:252
124705899170,9cyclictest1419666-21basename21:55:002
1247054991713,3cyclictest1241563-21kworker/u8:1+events_unbound20:48:321
1247051991714,2cyclictest60350irq/132-enp0s29f1:rx-023:35:250
1247051991714,2cyclictest1388132-21kworker/u8:1+flush-259:021:30:180
1247051991714,2cyclictest1388132-21kworker/u8:1+flush-259:021:30:170
1247051991714,2cyclictest1241563-21kworker/u8:1+events_unbound20:08:250
1247051991713,3cyclictest1252173-21kworker/u8:4+flush-259:019:45:200
1247051991711,4cyclictest1310649-21cat20:10:010
1247062991613,2cyclictest1545263-21kworker/u8:3+flush-259:000:10:173
1247062991612,3cyclictest1252173-21kworker/u8:4+flush-259:019:15:173
1247062991612,3cyclictest1252173-21kworker/u8:4+flush-259:019:15:173
124705899169,5cyclictest335557-21systemd-journal19:30:002
1247058991613,2cyclictest1560596-21sh00:10:002
1247058991613,2cyclictest1377440-21kworker/u8:3+flush-259:021:20:212
1247058991611,4cyclictest1545263-21kworker/u8:3+flush-259:000:25:262
124705899160,9cyclictest1482599-21munin-run22:55:012
1247054991613,2cyclictest1414465-21kworker/u8:4+flush-259:023:10:151
124705199169,1cyclictest1404174-21turbostat21:40:000
1247051991613,2cyclictest1425463-21kworker/u8:1+flush-259:022:00:090
1247051991613,2cyclictest1414465-21kworker/u8:4+events_unbound23:45:250
1247051991612,3cyclictest1377440-21kworker/u8:3+flush-259:021:50:220
1247062991511,3cyclictest1321039-21kworker/u8:4+flush-259:020:35:003
124705899159,4cyclictest335557-21systemd-journal19:40:002
1247058991512,2cyclictest1373286-21irqcore21:10:172
1247058991512,1cyclictest0-21swapper/220:10:002
1247058991511,3cyclictest1466235-21kworker/u8:0+flush-259:023:16:542
1247054991512,2cyclictest1267682-21kworker/u8:2+events_unbound19:54:551
1247051991513,1cyclictest60350irq/132-enp0s29f1:rx-020:40:220
1247051991512,2cyclictest60350irq/132-enp0s29f1:rx-020:26:590
1247062991411,2cyclictest1377440-21kworker/u8:3+flush-259:022:55:003
1247062991411,2cyclictest1377440-21kworker/u8:3+flush-259:021:50:273
1247051991411,2cyclictest1565445-21kworker/u8:1+flush-259:000:13:360
1247051991411,2cyclictest1377440-21kworker/u8:3+flush-259:021:20:130
1247051991411,2cyclictest1241563-21kworker/u8:1+events_unbound19:15:000
1247051991410,3cyclictest1523567-21kworker/u8:1+events_unbound23:50:240
1247051991410,3cyclictest1310072-21kworker/u8:0+flush-259:020:16:240
124706299136,5cyclictest1425342-21cat22:00:013
124705899138,3cyclictest1-21systemd21:18:242
124705899133,4cyclictest1404175-21munin-run21:40:002
124705899131,10cyclictest1472220-21awk22:45:012
124705499139,3cyclictest1310072-21kworker/u8:0+flush-259:020:19:021
124705199139,3cyclictest1570646-21kworker/u8:0+events_unbound00:37:460
124705199139,3cyclictest1545263-21kworker/u8:3+flush-259:000:16:350
124706299129,2cyclictest1430809-21cpuspeed_turbos22:05:133
124706299129,2cyclictest1383453-21fschecks_count21:20:173
124706299129,2cyclictest1247382-21cpuspeed_turbos19:10:183
124706299128,3cyclictest1524599-21kworker/u8:2+flush-259:023:40:173
124706299128,3cyclictest1377440-21kworker/u8:3+flush-259:022:45:193
124706299126,4cyclictest1467141-21base6422:40:023
1247062991210,1cyclictest0-21swapper/321:25:183
124706299118,2cyclictest1357464-21cpuspeed_turbos20:55:153
124705899118,2cyclictest1316110-21fschecks_count20:15:142
124705899110,3cyclictest1414477-21latency_hist21:50:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional