You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 09:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Jul 16, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
148810921730,3sleep3584-21kworker/3:2+events22:02:453
14998952950,3sleep20-21swapper/222:17:332
1312881996150,8cyclictest281-21systemd-journal20:20:000
1312886995645,9cyclictest281-21systemd-journal23:50:011
1312890995341,9cyclictest1543055-21/usr/sbin/munin23:00:012
1312886995243,7cyclictest1488715-21/usr/sbin/munin22:07:421
1312881995145,4cyclictest1567546-21kworker/u8:1+flush-8:000:05:000
1312890995046,3cyclictest1271730-21kworker/u8:0+events_unbound21:07:402
1312886995040,8cyclictest281-21systemd-journal00:30:001
1312881995045,3cyclictest1448534-21kworker/u8:3+flush-8:023:02:290
1312881994941,6cyclictest1408967-21kworker/u8:2+flush-8:021:37:290
1312881994839,7cyclictest1572735-21apt-get23:30:000
1312886994736,8cyclictest1443520-21latency_hist21:20:011
1312881994741,4cyclictest1567546-21kworker/u8:1+flush-8:023:37:280
15020642460,4sleep0161rcu_preempt22:17:350
1312886994638,5cyclictest1612584-21latency_hist00:10:011
1312890994541,3cyclictest1408967-21kworker/u8:2+events_unbound21:27:472
1312886994539,4cyclictest1602678-40logrotate23:59:591
1312881994540,3cyclictest1398869-21kworker/u8:1+events_unbound21:00:000
1312881994539,4cyclictest1271730-21kworker/u8:0+flush-8:020:47:420
1312886994437,5cyclictest1533626-21apt-get22:52:231
1312886994434,8cyclictest1313178-21/usr/sbin/munin19:12:371
1312881994436,6cyclictest1632624-21latency_hist00:30:010
1312881994333,8cyclictest1364572-21/usr/sbin/munin20:02:350
1312890994236,4cyclictest1463614-21kworker/u8:0+events_unbound23:12:432
1312881994237,4cyclictest1463614-21kworker/u8:0+events_unbound22:57:260
1312881994236,4cyclictest281-21systemd-journal00:15:010
1312890994137,3cyclictest1349365-21kworker/u8:3+events_unbound20:17:392
1312890994131,7cyclictest1587967-21cat23:45:002
1312886994134,5cyclictest1454112-21apt-get21:32:241
1312881994135,4cyclictest1463614-21kworker/u8:0+events_unbound21:47:340
1312881994135,4cyclictest1398869-21kworker/u8:1+flush-8:020:37:280
1312881994130,9cyclictest1163051-21kworker/u8:2+flush-8:019:17:470
1312890994036,3cyclictest1271730-21kworker/u8:0+events_unbound19:31:562
1312886994032,6cyclictest1271730-21kworker/u8:0+flush-8:019:42:431
1312886994031,7cyclictest281-21systemd-journal23:05:001
1312886994030,7cyclictest281-21systemd-journal00:12:581
1312881994034,4cyclictest1448534-21kworker/u8:3+flush-8:022:47:330
1312881994033,5cyclictest1432925-21ntpq21:07:360
1312881994031,6cyclictest1493854-21/usr/sbin/munin22:12:410
1312881994026,11cyclictest1271730-21kworker/u8:0+events_unbound20:15:010
1312886993934,3cyclictest1398869-21kworker/u8:1+flush-8:020:37:411
1312881993926,9cyclictest281-21systemd-journal23:25:000
1312890993828,7cyclictest1483409-21cat22:00:022
1312881993832,4cyclictest281-21systemd-journal00:35:520
1312881993824,10cyclictest1627455-21apt-get00:25:000
1312890993733,3cyclictest1582684-21kworker/u8:3+events_unbound23:45:182
1312890993733,3cyclictest1551228-21kworker/u8:2+events_unbound23:07:342
1312886993732,3cyclictest1448534-21kworker/u8:3+flush-8:021:55:021
1312881993733,3cyclictest1271730-21kworker/u8:0+flush-8:019:42:420
1312881993732,3cyclictest1428745-21kworker/u8:3+flush-8:021:10:010
1312881993730,5cyclictest1612603-21kworker/u8:2+flush-8:000:15:020
1312881993730,5cyclictest1271730-21kworker/u8:0+flush-8:019:32:260
1312881993730,4cyclictest1271730-21kworker/u8:0+flush-8:021:17:440
1312890993627,7cyclictest1448699-21turbostat.cron21:25:002
1312886993630,4cyclictest1163051-21kworker/u8:2+flush-8:020:32:281
1312886993629,5cyclictest1497607-21ntpq22:12:351
1312886993629,5cyclictest1163051-21kworker/u8:2+flush-8:019:52:421
1312881993627,7cyclictest1448534-21kworker/u8:3+flush-8:022:07:290
1312881993626,7cyclictest1373276-21ntpq20:07:370
1312881993623,9cyclictest281-21systemd-journal22:40:000
1312881993623,9cyclictest281-21systemd-journal21:55:010
1312881993528,4cyclictest1463614-21kworker/u8:0+flush-8:023:42:330
1312890993429,3cyclictest1271730-21kworker/u8:0+events_unbound20:07:312
1312886993426,6cyclictest1389051-21cp20:25:001
1312881993429,4cyclictest1463614-21kworker/u8:0+flush-8:022:27:270
1312881993429,3cyclictest1507434-21needreboot22:22:350
1312881993428,3cyclictest1527776-21unixbench_multi22:42:440
1312886993330,2cyclictest1469553-21irqcore21:47:321
1312886993329,3cyclictest1448534-21kworker/u8:3+events_unbound22:42:351
1312886993327,4cyclictest1513183-21apt22:30:011
1312881993328,3cyclictest1271730-21kworker/u8:0+flush-8:019:47:400
1312881993327,4cyclictest1271730-21kworker/u8:0+events_unbound21:22:420
1312881993326,5cyclictest1567546-21kworker/u8:1+events_unbound23:32:410
1312881993324,7cyclictest1404440-21/usr/sbin/munin20:42:420
13125192334,9sleep20-21swapper/219:07:482
1312886993228,2cyclictest0-21swapper/122:20:001
1312886993226,4cyclictest1312732-21kworker/u8:3+flush-8:019:17:291
1312886993224,6cyclictest281-21systemd-journal22:47:571
1312886993220,9cyclictest281-21systemd-journal21:42:561
1312881993227,4cyclictest1271730-21kworker/u8:0+flush-8:019:37:430
1312881993226,4cyclictest1389705-21tr20:27:260
1312881993224,5cyclictest1349365-21kworker/u8:3+flush-8:020:22:370
1312886993127,3cyclictest1393305-21needreboot20:27:351
1312881993127,3cyclictest1271730-21kworker/u8:0+flush-8:019:22:420
13614022300,2sleep10-21swapper/119:57:331
13268812300,4sleep1281rcuc/119:22:311
1312890993025,4cyclictest1408967-21kworker/u8:2+events_unbound21:12:542
1312890993022,6cyclictest1602700-21awk00:00:002
1312890993021,7cyclictest1419798-21sed20:57:322
1312886993026,3cyclictest1627181-21unixbench_multi00:22:431
1312886993026,3cyclictest1595395-21kthreadcore23:52:321
1312886993026,3cyclictest1398869-21kworker/u8:1+flush-8:021:02:281
1312886993025,3cyclictest1504490-21irqrtprio22:22:311
1312886993023,5cyclictest1433378-21unixbench_multi21:07:431
1312886993018,3cyclictest0-21swapper/123:42:271
1312881993021,3cyclictest1349365-21kworker/u8:3+events_unbound19:57:470
1312890992925,3cyclictest1567546-21kworker/u8:1+events_unbound00:27:192
1312890992925,3cyclictest1163051-21kworker/u8:2+events_unbound20:31:042
1312890992924,4cyclictest1453700-21kworker/u8:1+events_unbound21:30:132
1312890992924,3cyclictest1325433-21fschecks_time19:22:272
1312890992919,8cyclictest1389120-21cat20:25:012
1312886992925,3cyclictest1340481-21irqcore19:37:311
1312886992924,3cyclictest1463574-21idleruntime-cro21:40:001
1312881992925,3cyclictest1567546-21kworker/u8:1+flush-8:000:33:130
1312881992924,4cyclictest1448534-21kworker/u8:3+flush-8:022:52:280
1312881992924,4cyclictest1163051-21kworker/u8:2+flush-8:019:51:390
1312881992923,4cyclictest1463614-21kworker/u8:0+events_unbound21:42:330
1312881992923,4cyclictest1414685-21fschecks_time20:52:290
1312881992923,4cyclictest1414685-21fschecks_time20:52:290
1312881992919,7cyclictest1463614-21kworker/u8:0+flush-8:023:57:380
1312881992918,8cyclictest1592012-21ntpq23:47:360
1312890992824,2cyclictest1330347-21cut19:27:292
1312890992822,4cyclictest1398869-21kworker/u8:1+events_unbound20:50:072
1312890992822,4cyclictest1398869-21kworker/u8:1+events_unbound20:50:072
1312890992819,7cyclictest1478395-21turbostat.cron21:55:002
1312886992824,3cyclictest1640167-21kthreadcore00:37:311
1312886992824,3cyclictest1579080-21irqrtprio23:37:311
1312886992824,3cyclictest1567785-21idleruntime-cro23:25:001
1312886992820,6cyclictest1354305-21latency_hist19:50:001
1312881992823,4cyclictest1408967-21kworker/u8:2+flush-8:021:28:140
1312881992822,4cyclictest1394775-21cpuspeed_turbos20:32:260
13096842284,20sleep10-21swapper/119:07:311
14667832270,5sleep3451irq_work/321:42:353
1312890992723,3cyclictest1483371-21kworker/u8:1+events_unbound22:12:542
1312890992717,7cyclictest1488322-21awk22:05:002
1312886992723,3cyclictest1271730-21kworker/u8:0+flush-8:020:11:021
1312886992722,4cyclictest1438298-21unixbench_multi21:12:481
1312886992720,5cyclictest1271730-21kworker/u8:0+flush-8:019:32:411
1312886992715,9cyclictest1557204-21ntpq23:12:391
1312881992723,3cyclictest1398869-21kworker/u8:1+events_unbound21:04:010
1312881992721,5cyclictest1453700-21kworker/u8:1+flush-8:021:32:310
1312881992721,4cyclictest1271730-21kworker/u8:0+flush-8:019:12:350
1312890992622,2cyclictest1593575-21fschecks_time23:52:272
1312890992620,4cyclictest1572951-21base6423:30:002
1312890992618,6cyclictest281-21systemd-journal00:10:002
1312886992620,4cyclictest1622249-21unixbench_singl00:17:461
1312881992621,3cyclictest1567546-21kworker/u8:1+flush-8:023:54:050
1312881992620,3cyclictest1448534-21kworker/u8:3+events_unbound22:32:310
1312890992521,3cyclictest371rcuc/219:10:122
1312890992521,2cyclictest1503882-21aten2_r5power_v22:22:262
1312890992515,8cyclictest1518148-21awk22:35:002
1312890992515,8cyclictest1512518-21ntpq22:27:392
1312886992521,3cyclictest1517933-21unixbench_singl22:32:431
1312886992521,3cyclictest1163051-21kworker/u8:2+events_unbound20:17:291
1312886992521,2cyclictest1612603-21kworker/u8:2+events_unbound00:35:011
1312886992520,4cyclictest1463614-21kworker/u8:0+flush-8:023:30:341
1312886992515,8cyclictest281-21systemd-journal20:02:591
1312881992518,5cyclictest1582684-21kworker/u8:3+events_unbound00:10:000
1312881992510,11cyclictest1333716-21ntpq19:27:360
131289099247,2cyclictest161rcu_preempt20:47:262
1312890992421,2cyclictest1488770-21aten2_r5power_c22:07:262
1312890992420,2cyclictest1562592-21grep23:17:442
1312890992420,2cyclictest1529045-21fschecks_time22:47:282
1312890992419,3cyclictest1613283-21fschecks_count00:12:292
131288699242,15cyclictest582-21snmpd22:37:251
1312886992419,3cyclictest0-21swapper/123:25:571
1312886992418,4cyclictest1423049-21ntpq20:57:401
1312886992414,7cyclictest1374030-21latency_hist20:10:011
1312881992418,4cyclictest1463614-21kworker/u8:0+flush-8:023:07:270
1312881992418,4cyclictest1463614-21kworker/u8:0+events_unbound22:02:440
1312890992318,4cyclictest1528140-21apt-key22:45:002
1312886992319,3cyclictest0-21swapper/119:27:271
1312886992319,2cyclictest0-21swapper/123:10:001
1312886992318,4cyclictest1398869-21kworker/u8:1+flush-8:020:52:431
1312886992318,4cyclictest1398869-21kworker/u8:1+flush-8:020:52:421
1312886992317,4cyclictest1559672-21kthreadcore23:17:321
1312886992317,4cyclictest1488099-21unixbench_singl22:02:451
1312886992316,6cyclictest1463614-21kworker/u8:0+events_unbound21:52:261
1312881992320,2cyclictest451-21mta-sts-daemon23:17:390
1312881992319,3cyclictest1551228-21kworker/u8:2+events_unbound23:10:020
131289099229,2cyclictest1464046-21cut21:42:272
131289099227,2cyclictest0-21swapper/223:37:332
1312890992219,2cyclictest1633113-21aten2_r5power_e00:32:252
1312890992219,2cyclictest1349055-21grep19:42:452
1312890992219,2cyclictest1340205-21cut19:37:292
1312890992218,2cyclictest1424443-21cpuspeed_turbos21:02:272
1312890992212,8cyclictest1606942-21ntpq00:02:372
131289099220,8cyclictest1642505-21cron00:40:002
1312886992218,2cyclictest0-21swapper/120:42:421
131289099216,2cyclictest161rcu_preempt21:20:012
1312890992117,3cyclictest1359698-21aten2_r5power_c19:57:272
1312890992116,3cyclictest0-21swapper/222:55:002
1312890992115,1cyclictest421rcuog/219:17:002
1312890992115,1cyclictest161rcu_preempt23:02:402
1312890992114,2cyclictest161rcu_preempt00:22:362
1312890992110,9cyclictest1523080-21cat22:40:002
131289099210,19cyclictest1374775-21cut20:12:282
1312886992117,2cyclictest0-21swapper/121:27:321
1312886992116,3cyclictest0-21swapper/121:25:021
1312886992115,4cyclictest1409377-21apt-get20:47:231
1312881992117,2cyclictest0-21swapper/022:00:000
13488382200,2sleep3481ktimers/319:42:433
131289099203,1cyclictest0-21swapper/220:26:522
1312890992014,4cyclictest1565430-21sed23:22:332
1312886992014,4cyclictest0-21swapper/100:02:291
13080632203,12sleep00-21swapper/019:05:260
131289099199,2cyclictest161rcu_preempt00:17:382
131289099195,2cyclictest421rcuog/221:37:392
131289099193,2cyclictest161rcu_preempt20:02:282
131289099192,12cyclictest1468963-21apt-get21:47:262
1312890991916,2cyclictest1399803-21fschecks_time20:37:282
1312890991916,2cyclictest1350089-21fschecks_time19:47:272
1312890991910,7cyclictest1356117-21cut19:52:332
1312886991916,2cyclictest0-21swapper/122:57:291
13087372193,9sleep30-21swapper/319:07:293
131289099186,2cyclictest1573389-21sort23:32:242
131289099179,6cyclictest1405806-21tr20:42:332
15025742144,7sleep30-21swapper/322:17:403
13782702142,8sleep30-21swapper/320:12:373
16274822132,6sleep30-21swapper/300:25:013
16190452133,7sleep30-21swapper/300:17:353
15727222130,8sleep30-21swapper/323:30:013
15074352132,7sleep30-21swapper/322:22:363
14961602132,7sleep30-21swapper/322:12:333
14040602132,6sleep30-21swapper/320:40:013
13950432133,6sleep30-21swapper/320:32:313
13889392130,8sleep30-21swapper/320:25:013
13493312132,6sleep30-21swapper/319:45:013
16384942122,6sleep30-21swapper/300:37:303
16069822122,6sleep30-21swapper/300:02:383
16024802122,6sleep30-21swapper/323:57:453
15879242122,6sleep30-21swapper/323:45:013
15873752122,6sleep30-21swapper/323:42:443
15782232122,6sleep30-21swapper/323:35:583
15737472122,6sleep30-21swapper/323:32:293
15621672122,6sleep30-21swapper/323:17:413
15489452122,6sleep30-21swapper/323:07:303
15437392122,6sleep30-21swapper/323:02:283
15332042122,5sleep30-21swapper/322:50:003
15292902122,7sleep30-21swapper/322:47:323
15135882122,6sleep30-21swapper/322:32:243
15091502123,6sleep30-21swapper/322:27:303
14787652122,6sleep30-21swapper/321:56:563
14685502122,6sleep30-21swapper/321:45:013
14590542122,6sleep30-21swapper/321:37:273
14540502122,6sleep30-21swapper/321:31:573
14179272122,6sleep30-21swapper/320:52:373
14179272122,6sleep30-21swapper/320:52:373
13994272123,5sleep30-21swapper/320:36:563
13912082122,6sleep30-21swapper/320:27:333
13696682122,6sleep30-21swapper/320:07:273
13649792122,6sleep30-21swapper/320:02:303
13636582123,5sleep30-21swapper/319:57:443
13386762122,6sleep30-21swapper/319:32:373
13304702122,6sleep30-21swapper/319:27:313
13250562122,6sleep30-21swapper/319:22:223
13246232123,5sleep30-21swapper/319:20:013
13142262122,6sleep30-21swapper/319:12:353
16330012113,5sleep30-21swapper/300:32:033
16232992112,6sleep30-21swapper/300:22:283
16089672112,5sleep30-21swapper/300:07:323
15930312112,6sleep30-21swapper/323:50:113
15632782112,5sleep30-21swapper/323:22:263
15532022112,6sleep30-21swapper/323:10:593
15385332112,5sleep30-21swapper/322:57:233
15235312112,5sleep30-21swapper/322:42:263
15188182112,6sleep30-21swapper/322:37:293
14892232112,5sleep30-21swapper/322:07:323
14737742112,6sleep30-21swapper/321:50:553
14518952112,5sleep30-21swapper/321:27:363
14435642113,5sleep30-21swapper/321:20:013
14392502112,6sleep30-21swapper/321:17:293
14346222112,5sleep30-21swapper/321:12:363
14289632112,6sleep30-21swapper/321:05:133
14280512112,5sleep30-21swapper/321:02:403
14196432112,6sleep30-21swapper/320:57:313
14092272112,6sleep30-21swapper/320:45:473
13794662112,5sleep30-21swapper/320:17:223
13547372111,6sleep30-21swapper/319:52:273
13436302112,6sleep30-21swapper/319:37:383
16128122102,5sleep30-21swapper/300:10:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional