You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 11:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Jun 20, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1257170995550,3cyclictest1360761-21kworker/u8:2+events_unbound21:05:010
1257183995446,5cyclictest1444185-21latency_hist22:10:013
1257183995446,5cyclictest1444185-21latency_hist22:10:003
1257170995046,2cyclictest1433818-21kworker/u8:3+events_unbound22:30:190
1257176994943,4cyclictest1350756-21latency_hist20:40:012
1257183994841,5cyclictest335557-21systemd-journal00:30:013
1257183994841,5cyclictest335557-21systemd-journal00:30:003
1257183994742,4cyclictest1381633-21gpgv21:10:013
1257173994742,4cyclictest1407874-21cp21:35:001
1257176994337,4cyclictest1267811-21latency_hist19:20:002
1257170994340,2cyclictest1429057-21apt-get21:55:110
1257176994135,4cyclictest1262227-21apt-get19:15:012
1257170994137,3cyclictest1350795-21kworker/u8:0+flush-259:021:05:360
1257176994035,3cyclictest335557-21systemd-journal20:15:362
1257176993935,3cyclictest1490329-21kworker/u8:0+flush-259:000:00:252
1257170993935,3cyclictest1574042-21kworker/u8:0+flush-259:000:35:010
1257170993935,3cyclictest1574042-21kworker/u8:0+flush-259:000:35:000
1257170993935,3cyclictest1262189-21kworker/u8:1+flush-259:019:30:200
1257183993832,4cyclictest1469802-21kworker/u8:2+flush-259:022:50:003
1257176993834,3cyclictest1521388-21kworker/u8:1+flush-259:023:35:272
1257170993835,2cyclictest1209701-21kworker/u8:3+flush-259:019:45:200
1257183993731,4cyclictest1209701-21kworker/u8:3+flush-259:019:55:163
1257170993633,2cyclictest1387377-21kworker/u8:4+events_unbound21:25:190
1257170993632,3cyclictest1433818-21kworker/u8:3+events_unbound22:57:360
1257170993531,3cyclictest1574042-21kworker/u8:0+events_unbound00:18:570
1257170993531,3cyclictest1324903-21apt-get20:13:560
1257173993429,3cyclictest1531643-21apt-get23:35:011
1257170993430,3cyclictest1381236-21kworker/u8:1+flush-259:022:00:150
1257170993330,2cyclictest1433818-21kworker/u8:3+flush-259:022:10:220
1257170993329,3cyclictest1439298-21kworker/u8:0+events_unbound22:19:360
1257170993329,3cyclictest1360761-21kworker/u8:2+events_unbound21:14:370
1257183993228,3cyclictest1537285-21kworker/u8:2+flush-259:023:55:003
1257176993227,4cyclictest1490329-21kworker/u8:0+events_unbound23:25:232
1257173993228,3cyclictest335557-21systemd-journal00:27:581
1257173993228,3cyclictest335557-21systemd-journal00:27:571
1257170993228,3cyclictest1490329-21kworker/u8:0+flush-259:023:25:170
1257170993227,4cyclictest1511111-21kworker/u8:2+flush-259:023:20:110
1257183993124,5cyclictest1579093-21gpgv00:20:013
1257183993124,5cyclictest1532272-21cp23:35:023
1257176993127,3cyclictest1360761-21kworker/u8:2+flush-259:021:00:262
1257173993124,5cyclictest1401689-21ntpq21:25:181
1257173993123,6cyclictest1568244-21apt-get00:09:591
1257170993127,3cyclictest1531524-21kworker/u8:3+events_unbound00:10:240
1257170993126,4cyclictest1558138-21kworker/u8:4+events_unbound00:03:480
1257173993027,2cyclictest1433818-21kworker/u8:3+events_unbound22:10:271
1257173993024,4cyclictest335557-21systemd-journal19:40:001
1257170993027,2cyclictest1298761-21kworker/u8:4+events_unbound19:54:380
1257170993027,2cyclictest1298761-21kworker/u8:4+events_unbound19:54:380
1257170993027,2cyclictest1262189-21kworker/u8:1+flush-259:020:20:210
1257170993026,3cyclictest1433818-21kworker/u8:3+flush-259:022:40:260
1257183992925,2cyclictest1278421-21apt-get19:30:123
1257176992926,2cyclictest1511111-21kworker/u8:2+events_unbound23:30:202
1257173992923,4cyclictest1318540-21ntpq20:05:251
1257170992925,3cyclictest1547851-21apt-get23:50:100
1257170992925,3cyclictest1490329-21kworker/u8:0+events_unbound23:19:380
1257170992925,3cyclictest1209701-21kworker/u8:3+flush-259:020:30:210
1257170992924,4cyclictest1439298-21kworker/u8:0+flush-259:022:20:160
1257170992924,3cyclictest1366454-21apt-get20:55:120
1257183992823,4cyclictest1382268-21/usr/sbin/munin21:10:193
1257176992822,4cyclictest335557-21systemd-journal00:10:022
1257176992822,4cyclictest1360158-21ntpq20:45:222
1257173992822,4cyclictest335557-21systemd-journal20:48:361
1257173992821,5cyclictest1520448-21ntpq23:20:211
1257170992824,3cyclictest1574042-21kworker/u8:0+events_unbound00:35:210
1257170992824,3cyclictest1433818-21kworker/u8:3+events_unbound22:45:180
1257176992723,3cyclictest1209701-21kworker/u8:3+flush-259:019:45:172
1257176992722,4cyclictest1433818-21kworker/u8:3+events_unbound23:10:202
1257176992722,3cyclictest1350795-21kworker/u8:0+events_unbound20:50:022
1257176992721,4cyclictest1480207-21latency_hist22:45:022
1257176992720,5cyclictest335557-21systemd-journal23:05:362
1257173992721,4cyclictest1470148-21/usr/sbin/munin22:35:121
1257170992723,3cyclictest1387169-21kworker/u8:3+events_unbound21:20:200
1257170992720,5cyclictest1567406-21ntpq00:05:220
1257170992719,5cyclictest1272997-21systemctl19:25:000
1257183992621,4cyclictest1423896-21apt-get21:50:123
1257176992622,3cyclictest1298761-21kworker/u8:4+events_unbound20:00:202
1257176992622,3cyclictest1209701-21kworker/u8:3+flush-259:019:50:212
1257176992622,3cyclictest1209701-21kworker/u8:3+flush-259:019:50:212
1257176992621,4cyclictest1209701-21kworker/u8:3+flush-259:020:40:212
1257173992620,4cyclictest1532325-21apt-get23:35:111
1257170992622,3cyclictest1531524-21kworker/u8:3+events_unbound23:45:180
1257170992622,3cyclictest1209701-21kworker/u8:3+events_unbound19:35:100
1257183992518,5cyclictest1463912-21ntpq22:25:213
1257176992523,1cyclictest1579630-21kworker/u8:2+flush-259:000:30:212
1257176992523,1cyclictest1579630-21kworker/u8:2+flush-259:000:30:202
1257176992521,3cyclictest1381236-21kworker/u8:1+events_unbound21:30:192
1257170992522,2cyclictest1480250-21kworker/u8:4+events_unbound22:51:380
1257170992521,3cyclictest1469802-21kworker/u8:2+events_unbound22:35:150
1257170992521,3cyclictest1413539-21kworker/u8:0+events_unbound21:50:140
1257170992521,3cyclictest1298761-21kworker/u8:4+events_unbound20:15:210
1257170992521,3cyclictest1298761-21kworker/u8:4+events_unbound19:59:380
1257183992420,3cyclictest1511111-21kworker/u8:2+flush-259:023:20:253
1257183992420,2cyclictest1490329-21kworker/u8:0+flush-259:023:05:103
1257183992419,3cyclictest1335578-21apt-get20:25:113
1257183992418,4cyclictest1479328-21ntpq22:40:193
1257176992421,2cyclictest1381236-21kworker/u8:1+flush-259:022:00:172
1257176992419,4cyclictest1439298-21kworker/u8:0+flush-259:022:20:002
1257176992418,4cyclictest335557-21systemd-journal22:47:362
1257176992417,5cyclictest1516231-21latency_hist23:20:012
1257173992421,2cyclictest1531524-21kworker/u8:3+events_unbound00:01:481
1257173992419,3cyclictest1392330-21latency_hist21:20:011
1257170992420,3cyclictest1262189-21kworker/u8:1+flush-259:020:35:160
1257170992416,3cyclictest1537285-21kworker/u8:2+events_unbound23:55:250
1257183992317,4cyclictest335557-21systemd-journal21:20:013
1257176992319,3cyclictest1209701-21kworker/u8:3+events_unbound19:20:372
1257176992318,3cyclictest1381236-21kworker/u8:1+flush-259:022:05:242
1257176992318,3cyclictest1381236-21kworker/u8:1+flush-259:022:05:242
1257176992317,4cyclictest1531524-21kworker/u8:3+flush-259:023:40:162
1257173992320,2cyclictest1298761-21kworker/u8:4+events_unbound19:51:041
1257173992320,2cyclictest1298761-21kworker/u8:4+events_unbound19:51:041
1257173992318,3cyclictest1330442-21apt-get20:20:121
1257173992317,4cyclictest1262229-21latency_hist19:15:001
1257170992320,2cyclictest1574042-21kworker/u8:0+events_unbound00:25:210
1257170992320,2cyclictest1574042-21kworker/u8:0+events_unbound00:25:200
1257170992319,3cyclictest1387377-21kworker/u8:4+flush-259:021:35:220
1257170992315,6cyclictest1292626-21ntpq19:40:200
1257176992218,2cyclictest1229037-21kworker/u8:0+events_unbound19:10:002
1257176992216,4cyclictest1381722-21gpgv21:10:012
1257176992215,5cyclictest1413308-21latency_hist21:40:002
1257173992219,2cyclictest1360761-21kworker/u8:2+events_unbound20:55:531
1257173992218,3cyclictest1209701-21kworker/u8:3+flush-259:020:50:141
1257173992217,3cyclictest1325302-21apt-get20:15:121
1257170992219,2cyclictest1262189-21kworker/u8:1+events_unbound20:04:360
1257170992218,3cyclictest1521388-21kworker/u8:1+flush-259:023:35:220
1257170992218,3cyclictest1511111-21kworker/u8:2+flush-259:023:30:220
1257170992218,3cyclictest1209701-21kworker/u8:3+events_unbound20:50:120
1257183992116,4cyclictest1537285-21kworker/u8:2+flush-259:023:55:163
1257183992115,4cyclictest335557-21systemd-journal20:45:003
1257183992115,4cyclictest1262227-21apt-get19:15:023
1257176992116,4cyclictest1262189-21kworker/u8:1+flush-259:019:25:172
1257176992115,4cyclictest1521366-21latency_hist23:25:022
1257173992118,2cyclictest1381236-21kworker/u8:1+events_unbound21:44:131
1257173992118,2cyclictest1360761-21kworker/u8:2+flush-259:021:00:171
1257173992117,3cyclictest1579630-21kworker/u8:2+flush-259:000:23:261
1257173992116,3cyclictest1574042-21kworker/u8:0+flush-259:000:35:151
1257170992118,2cyclictest1433818-21kworker/u8:3+flush-259:023:10:220
1257170992117,3cyclictest1413539-21kworker/u8:0+events_unbound21:40:240
1257170992117,3cyclictest1298761-21kworker/u8:4+flush-259:020:25:210
1257170992117,3cyclictest1209701-21kworker/u8:3+flush-259:020:40:170
1257170992117,3cyclictest1209701-21kworker/u8:3+events_unbound20:05:430
1257170992117,3cyclictest1209701-21kworker/u8:3+events_unbound19:15:110
125717099211,18cyclictest1464800-21unin-run22:30:000
1257183992017,2cyclictest1531524-21kworker/u8:3+flush-259:000:05:233
1257183992014,4cyclictest1568917-21/usr/sbin/munin00:10:203
1257176992016,3cyclictest1574042-21kworker/u8:0+events_unbound00:25:232
1257176992016,3cyclictest1574042-21kworker/u8:0+events_unbound00:25:232
1257176992016,3cyclictest1381236-21kworker/u8:1+flush-259:021:45:242
1257176992016,3cyclictest1298761-21kworker/u8:4+events_unbound20:25:152
1257176992016,3cyclictest1209701-21kworker/u8:3+flush-259:020:13:572
1257176992016,2cyclictest1413539-21kworker/u8:0+flush-259:021:55:202
1257176992014,4cyclictest1287494-21ntpq19:35:182
1257173992017,2cyclictest1531524-21kworker/u8:3+events_unbound00:16:371
1257173992017,2cyclictest1531524-21kworker/u8:3+events_unbound00:13:311
1257173992017,2cyclictest1490329-21kworker/u8:0+events_unbound22:56:201
1257173992017,2cyclictest1433818-21kworker/u8:3+events_unbound23:13:341
1257173992017,2cyclictest1433818-21kworker/u8:3+events_unbound23:07:281
1257173992017,2cyclictest1413539-21kworker/u8:0+events_unbound21:52:131
1257173992017,2cyclictest1381236-21kworker/u8:1+events_unbound21:55:011
1257173992016,3cyclictest1293577-21kworker/u8:0+flush-259:019:59:591
1257173992016,3cyclictest1262189-21kworker/u8:1+events_unbound20:02:211
1257173992013,5cyclictest1485596-21/usr/sbin/munin22:50:131
125717399200,17cyclictest1-21systemd22:45:001
1257170992016,3cyclictest1531524-21kworker/u8:3+events_unbound23:40:140
1257183991915,3cyclictest1521388-21kworker/u8:1+flush-259:023:40:223
1257183991915,3cyclictest1209701-21kworker/u8:3+flush-259:020:50:233
1257183991915,3cyclictest1209701-21kworker/u8:3+flush-259:019:45:163
1257183991912,5cyclictest335557-21systemd-journal00:04:593
1257176991914,3cyclictest1574042-21kworker/u8:0+events_unbound00:20:172
1257176991913,5cyclictest1578979-21latency_hist00:20:012
1257176991913,4cyclictest1283271-21latency_hist19:35:012
1257173991917,2cyclictest1381236-21kworker/u8:1+events_unbound21:09:131
1257173991916,2cyclictest1579630-21kworker/u8:2+events_unbound00:33:111
1257173991916,2cyclictest1579630-21kworker/u8:2+events_unbound00:33:101
1257173991916,2cyclictest1537285-21kworker/u8:2+events_unbound23:48:071
1257173991916,2cyclictest1490329-21kworker/u8:0+events_unbound23:03:091
1257173991916,2cyclictest1464407-21kworker/u8:1+events_unbound22:34:131
1257173991916,2cyclictest1387377-21kworker/u8:4+events_unbound21:36:461
1257173991916,2cyclictest1209701-21kworker/u8:3+events_unbound20:42:481
1257173991916,2cyclictest1209701-21kworker/u8:3+events_unbound19:20:571
1257173991914,3cyclictest335557-21systemd-journal19:47:361
1257173991912,5cyclictest1340714-21/usr/sbin/munin20:30:151
1257170991916,2cyclictest1490329-21kworker/u8:0+flush-259:023:00:180
1257183991814,3cyclictest1381236-21kworker/u8:1+flush-259:021:55:253
1257183991810,5cyclictest1453531-21ntpq22:15:203
1257176991814,3cyclictest1360761-21kworker/u8:2+flush-259:020:55:222
1257176991813,3cyclictest1531524-21kworker/u8:3+flush-259:000:05:172
1257173991816,2cyclictest1433818-21kworker/u8:3+events_unbound22:15:061
1257173991815,2cyclictest1537285-21kworker/u8:2+events_unbound23:55:441
1257173991815,2cyclictest1462198-21kthreadcore22:25:171
1257173991815,2cyclictest1439298-21kworker/u8:0+events_unbound22:08:351
1257173991815,2cyclictest1439298-21kworker/u8:0+events_unbound22:08:351
1257170991814,3cyclictest1229037-21kworker/u8:0+events_unbound19:10:370
1257183991714,2cyclictest1413298-21idleruntime-cro21:40:013
1257183991713,3cyclictest1490329-21kworker/u8:0+flush-259:023:05:003
1257176991714,2cyclictest1433818-21kworker/u8:3+flush-259:022:55:232
1257176991712,4cyclictest1262189-21kworker/u8:1+events_unbound20:30:202
1257176991712,4cyclictest1209701-21kworker/u8:3+flush-259:019:55:162
1257176991711,4cyclictest1557888-21gzip00:00:002
1257173991714,2cyclictest1490329-21kworker/u8:0+events_unbound23:27:341
1257173991714,2cyclictest1449319-21kworker/u8:2+events_unbound22:22:011
1257173991714,2cyclictest1360761-21kworker/u8:2+events_unbound21:11:181
1257173991714,2cyclictest1283294-21kworker/u8:2+events_unbound19:42:581
1257173991714,2cyclictest1262189-21kworker/u8:1+events_unbound19:26:181
1257173991714,2cyclictest1209701-21kworker/u8:3+events_unbound19:31:591
1257173991713,3cyclictest1531524-21kworker/u8:3+events_unbound23:43:481
1257173991712,3cyclictest1480449-21/usr/sbin/munin22:45:191
1257170991713,3cyclictest1490329-21kworker/u8:0+flush-259:023:05:210
1257170991713,3cyclictest1262189-21kworker/u8:1+flush-259:019:25:270
1257183991612,3cyclictest509-21rs:main3
1257183991611,4cyclictest1298761-21kworker/u8:4+flush-259:020:10:163
1257183991611,3cyclictest1490786-21apt-get22:55:123
1257176991613,2cyclictest1449319-21kworker/u8:2+events_unbound22:25:162
1257176991613,2cyclictest1316803-21kthreadcore20:05:182
125717399166,6cyclictest32-21ksoftirqd/119:20:001
1257173991613,2cyclictest1490329-21kworker/u8:0+events_unbound23:53:191
1257173991613,2cyclictest1209701-21kworker/u8:3+events_unbound20:11:481
1257173991612,2cyclictest1335994-21irqcore20:25:161
1257173991611,4cyclictest335557-21systemd-journal20:35:361
1257170991614,1cyclictest60350irq/132-enp0s29f1:rx-020:45:070
1257170991612,3cyclictest1381236-21kworker/u8:1+events_unbound22:05:010
1257170991612,3cyclictest1381236-21kworker/u8:1+events_unbound22:05:010
1257183991512,2cyclictest1579630-21kworker/u8:2+flush-259:000:33:413
1257183991512,2cyclictest1579630-21kworker/u8:2+flush-259:000:33:413
1257183991512,2cyclictest1345605-21idleruntime-cro20:35:003
1257183991510,3cyclictest1278156-21latency_hist19:30:013
125717699158,5cyclictest1417645-21ntpq21:40:212
1257176991512,2cyclictest1489621-21ntp_kernel_pll_22:50:192
1257176991511,3cyclictest1574042-21kworker/u8:0+flush-259:000:35:232
1257176991511,3cyclictest1469802-21kworker/u8:2+events_unbound22:35:202
125717399153,2cyclictest32-21ksoftirqd/121:20:191
1257170991512,2cyclictest60350irq/132-enp0s29f1:rx-000:20:190
1257170991512,2cyclictest1381236-21kworker/u8:1+events_unbound21:45:440
1257170991511,3cyclictest1387169-21kworker/u8:3+events_unbound21:15:280
125718399147,5cyclictest1506184-21/usr/sbin/munin23:10:183
1257183991411,2cyclictest503-21tpm2-abrmd20:04:593
1257183991410,3cyclictest1298761-21kworker/u8:4+flush-259:020:15:253
1257176991410,3cyclictest1465034-21apt-get22:30:092
125717399149,1cyclictest191rcu_preempt23:16:351
125717399142,3cyclictest32-21ksoftirqd/121:45:221
125718399138,4cyclictest1490329-21kworker/u8:0+flush-259:023:15:263
125718399138,4cyclictest1303921-21latency_hist19:55:013
125718399138,3cyclictest1531328-21journal-offline23:31:263
1257183991310,2cyclictest1423655-21kworker/u8:2+flush-259:022:00:233
1257183991310,2cyclictest1360554-21unixbench_multi20:45:253
1257176991310,1cyclictest0-21swapper/223:05:002
125717399131,3cyclictest32-21ksoftirqd/122:00:201
125718399129,2cyclictest1490108-21unixbench_singl22:50:233
125718399129,2cyclictest1376054-21unixbench_singl21:00:253
125718399129,2cyclictest0-21swapper/322:10:213
125718399127,4cyclictest1381236-21kworker/u8:1+flush-259:021:45:003
125717699129,2cyclictest1444512-21cpuspeed_turbos22:10:132
125717699127,4cyclictest1387169-21kworker/u8:3+events_unbound21:15:242
125718399119,1cyclictest0-21swapper/323:49:593
125718399118,2cyclictest1418906-21fschecks_count21:45:133
125718399117,3cyclictest1229037-21kworker/u8:0+flush-259:019:10:353
125717099119,1cyclictest60350irq/132-enp0s29f1:rx-021:30:230
125718399107,2cyclictest1370868-21unixbench_multi20:55:263
125718399106,3cyclictest1381236-21kworker/u8:1+flush-259:021:30:323
125718399105,4cyclictest1303001-21seq19:50:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional