You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 03:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Sep 03, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4314322580,6chrt0-21swapper/223:27:472
172373995647,7cyclictest184558-21/usr/sbin/munin19:22:440
172383995041,7cyclictest327802-21gpgv21:45:012
172373995041,7cyclictest275-21systemd-journal23:10:010
4423522440,2sleep3575-21kworker/3:2+events23:42:293
172376994436,5cyclictest189092-21latency_hist19:25:011
172376994434,7cyclictest481889-21latency_hist00:20:011
172376994434,7cyclictest278283-21latency_hist20:55:001
172376994434,7cyclictest278283-21latency_hist20:54:591
3746802420,4sleep30-21swapper/322:32:353
172373994131,8cyclictest257768-21ntpq20:32:370
172373994030,8cyclictest442500-21diskstats23:42:300
17237399400,37cyclictest238493-21true20:15:000
1979122390,6sleep3451irq_work/319:32:373
172376993933,4cyclictest179354-21kworker/u8:1+flush-8:021:47:311
172373993929,8cyclictest492441-21/usr/sbin/munin00:32:460
172373993832,4cyclictest238494-21kworker/u8:2+flush-8:021:17:320
172376993731,4cyclictest263477-21latency_hist20:40:011
172376993727,7cyclictest275-21systemd-journal00:20:321
172373993730,5cyclictest275-21systemd-journal22:40:000
172376993627,6cyclictest402153-21latency_hist23:00:011
172373993630,4cyclictest238494-21kworker/u8:2+flush-8:020:22:310
172373993629,5cyclictest326915-21ntpq21:42:400
172373993628,6cyclictest357326-21unixbench_multi22:12:460
172376993526,7cyclictest275-21systemd-journal20:40:551
172373993527,3cyclictest238494-21kworker/u8:2+flush-8:022:52:310
17237399350,33cyclictest431897-21true23:30:010
4483082340,4sleep3575-21kworker/3:2-events23:47:353
172376993427,5cyclictest275-21systemd-journal21:35:001
172376993426,6cyclictest275-21systemd-journal21:36:551
172373993424,8cyclictest482001-21cp00:20:000
172376993328,3cyclictest451962-21apt-key23:50:011
172376993326,5cyclictest275-21systemd-journal20:02:551
172373993326,5cyclictest208884-21cron19:45:000
172373993324,7cyclictest362515-21turbostat.cron22:20:000
172373993322,8cyclictest275-21systemd-journal22:43:380
172376993225,5cyclictest3031583-21kworker/u8:4+flush-8:021:52:261
172373993226,4cyclictest441556-21unixbench_singl23:37:470
172373993226,4cyclictest422729-21fschecks_time23:22:290
172373993226,4cyclictest365126-21kthreadcore22:22:340
172373993226,4cyclictest344112-21kthreadcore22:02:350
172373993226,3cyclictest402155-21sh23:00:010
172376993128,2cyclictest213563-21grep19:47:461
172376993127,3cyclictest358372-21fschecks_time22:17:351
172373993126,3cyclictest259569-21irqcore20:37:330
172373993126,3cyclictest172938-21cpuspeed_turbos19:12:300
172373993125,4cyclictest482867-21fschecks_count00:22:320
172373993125,4cyclictest461821-21cron00:00:000
172373993125,4cyclictest452712-21fschecks_time23:52:300
172373993124,5cyclictest213576-21unixbench_singl19:47:470
172373993122,7cyclictest462650-21fschecks_time00:02:310
172373993121,8cyclictest253596-21cron20:30:000
172383993025,4cyclictest3031583-21kworker/u8:4+flush-8:021:27:462
172376993026,3cyclictest3031583-21kworker/u8:4+flush-8:020:55:011
172376993024,4cyclictest179607-21apt-get19:17:261
172373993025,3cyclictest447473-21fschecks_count23:47:300
172373993025,3cyclictest350301-21kthreadcore22:07:350
172373993024,4cyclictest334010-21irqrtprio21:52:330
172373993024,4cyclictest284256-21sort21:02:320
172373993024,4cyclictest193762-21unixbench_multi19:27:470
172383992926,2cyclictest258254-21unixbench_multi20:32:452
172383992924,4cyclictest402404-21kworker/u8:1+flush-8:000:22:312
172376992925,3cyclictest201572-21kthreadcore19:37:351
172376992924,3cyclictest293770-21cpuspeed_turbos21:12:291
172376992924,3cyclictest234699-21irqrtprio20:12:381
172376992924,2cyclictest0-21swapper/100:12:381
172373992924,3cyclictest307647-21unixbench_multi21:22:480
172373992923,4cyclictest388099-21fschecks_count22:47:320
172373992923,4cyclictest388099-21fschecks_count22:47:320
172373992923,4cyclictest373194-21fschecks_time22:32:300
172373992923,4cyclictest372127-21unixbench_multi22:27:460
172373992923,4cyclictest279243-21irqcore20:57:340
172373992923,4cyclictest199706-21fschecks_count19:37:300
172373992922,5cyclictest472229-21aten2_r5power_c00:12:320
172373992921,6cyclictest268166-21unixbench_multi20:42:470
172376992824,3cyclictest431896-21systemd-run23:30:011
172376992824,3cyclictest214475-21cpuspeed_turbos19:52:321
172376992822,4cyclictest352411-21unixbench_singl22:07:461
172376992819,6cyclictest312847-21latency_hist21:30:011
172373992823,4cyclictest3031583-21kworker/u8:4+flush-8:021:37:430
172373992823,3cyclictest432580-21fschecks_count23:32:310
172373992823,3cyclictest273101-21unixbench_multi20:47:470
172373992823,3cyclictest229390-21fschecks_time20:07:310
172373992823,3cyclictest219397-21cpuspeed_turbos19:57:290
172373992822,4cyclictest342463-21unixbench_multi21:57:510
172373992822,4cyclictest239201-21fschecks_count20:17:290
172373992822,4cyclictest194722-21fschecks_count19:32:300
172373992821,4cyclictest412765-21fschecks_count23:12:300
172383992724,2cyclictest228320-21unixbench_multi20:02:472
172383992710,5cyclictest0-21swapper/220:47:412
172376992722,4cyclictest431197-21kworker/u8:2+events_unbound23:35:011
172376992721,4cyclictest0-21swapper/123:55:001
172376992719,6cyclictest338210-21/usr/sbin/munin21:57:491
172373992722,3cyclictest278267-21cron20:55:000
172373992722,3cyclictest278267-21cron20:55:000
172373992722,3cyclictest20823-21cron21:50:000
3436762260,2sleep3471rcuc/322:02:333
172376992623,2cyclictest375014-21kthreadcore22:32:351
172376992622,3cyclictest238494-21kworker/u8:2+events_unbound22:47:481
172376992622,3cyclictest238494-21kworker/u8:2+events_unbound22:47:481
172376992622,2cyclictest382411-21cron22:40:001
172376992622,2cyclictest0-21swapper/100:00:001
172376992621,4cyclictest275-21systemd-journal21:06:551
172376992620,5cyclictest342644-21kworker/u8:0+flush-8:022:12:441
172376992620,4cyclictest492820-21fschecks_time00:32:321
172373992620,4cyclictest238494-21kworker/u8:2+flush-8:023:02:410
172373992620,4cyclictest179958-21fschecks_time19:17:310
172373992619,4cyclictest0-21swapper/020:05:000
172373992618,6cyclictest487778-21diskstats00:27:290
172373992613,10cyclictest275-21systemd-journal19:55:000
17212722612,8sleep30-21swapper/319:09:103
172383992521,3cyclictest392964-21cpuspeed_turbos22:52:302
172383992521,3cyclictest372715-21kworker/u8:3+flush-8:000:10:002
172383992520,4cyclictest342644-21kworker/u8:0+flush-8:022:32:462
172383992520,4cyclictest283208-21idleruntime-cro21:00:002
172383992519,4cyclictest259900-21kthreadcore20:37:342
172383992519,4cyclictest223397-21unixbench_multi19:57:462
172376992521,3cyclictest401-21dbus-daemon23:45:011
172376992521,2cyclictest497993-21irqcore00:37:341
172376992521,2cyclictest463222-21kthreadcore00:02:351
172376992521,2cyclictest0-21swapper/120:27:431
172376992521,2cyclictest0-21swapper/119:32:311
172376992521,2cyclictest0-21swapper/119:12:351
172376992520,4cyclictest417003-21turbostat.cron23:14:591
172376992520,3cyclictest244611-21irqrtprio20:22:341
172376992519,5cyclictest179354-21kworker/u8:1+flush-8:022:27:301
172376992519,4cyclictest437272-21apt-get23:37:271
172376992515,7cyclictest275-21systemd-journal23:17:551
172376992512,3cyclictest275-21systemd-journal21:25:001
172373992519,4cyclictest1-21systemd00:07:160
172373992519,3cyclictest0-21swapper/021:10:010
172373992519,3cyclictest0-21swapper/000:40:000
172383992421,2cyclictest442601-21fschecks_time23:42:312
172383992420,2cyclictest318249-21aten2_r5power_c21:37:282
172383992419,3cyclictest290758-21kthreadcore21:07:362
172383992418,5cyclictest3031583-21kworker/u8:4+flush-8:021:02:422
172383992417,5cyclictest275-21systemd-journal22:40:002
172376992419,3cyclictest285823-21kthreadcore21:02:341
172373992418,4cyclictest1-21systemd21:15:010
172373992418,3cyclictest0-21swapper/023:20:010
4320512230,2sleep3481ktimers/323:30:013
172383992320,2cyclictest407597-21aten2_r5power_c23:07:272
172383992319,2cyclictest0-21swapper/220:52:372
172383992319,2cyclictest0-21swapper/220:52:372
172383992318,4cyclictest491758-21unixbench_multi00:27:442
172383992318,3cyclictest358749-21cut22:17:382
172383992314,7cyclictest475227-21tr00:12:412
17237699232,13cyclictest0-21swapper/119:27:281
172376992319,3cyclictest0-21swapper/122:42:471
172376992319,3cyclictest0-21swapper/120:35:001
172376992318,3cyclictest402843-21cpuspeed_turbos23:02:291
172376992318,3cyclictest167303-21kworker/u8:0+events_unbound19:45:011
172376992316,5cyclictest0-21swapper/123:07:351
172376992311,3cyclictest3436752if_err_enp4s022:02:331
172373992318,3cyclictest312610-21unixbench_singl21:27:490
172383992219,2cyclictest253320-21unixbench_multi20:27:462
172383992218,2cyclictest413422-21tail23:12:342
172383992218,2cyclictest387922-21aten2_r5power_v22:47:302
172383992218,2cyclictest387922-21aten2_r5power_v22:47:302
172383992218,2cyclictest0-21swapper/200:20:002
172383992217,4cyclictest193789-21unixbench_singl19:27:472
172383992217,4cyclictest179354-21kworker/u8:1+flush-8:019:15:062
172383992217,3cyclictest372119-21unixbench_multi22:27:452
172383992214,6cyclictest313624-21cut21:32:322
172383992210,4cyclictest0-21swapper/221:22:322
172376992218,3cyclictest229098-21tr20:07:281
172376992218,2cyclictest0-21swapper/119:57:301
172376992218,2cyclictest0-21swapper/100:27:441
172376992217,4cyclictest3031583-21kworker/u8:4+events_unbound21:17:411
172376992211,8cyclictest323171-21apt-get21:42:281
1676582224,11sleep10-21swapper/119:06:591
17238399212,14cyclictest302191-21ntpq21:17:392
172383992118,2cyclictest244243-21fschecks_time20:22:302
172383992118,2cyclictest218457-21unixbench_multi19:52:492
172383992117,3cyclictest293858-21fschecks_time21:12:312
172383992117,2cyclictest204429-21aten2_r5power_e19:42:282
172383992117,2cyclictest0-21swapper/222:05:012
172383992116,3cyclictest348458-21fschecks_time22:07:312
172383992111,8cyclictest0-21swapper/220:12:422
172383992111,7cyclictest177247-21cron19:15:002
17237699217,5cyclictest0-21swapper/100:05:041
172376992118,2cyclictest0-21swapper/122:22:421
172376992117,2cyclictest0-21swapper/123:22:421
172376992117,2cyclictest0-21swapper/122:55:001
172376992117,2cyclictest0-21swapper/120:17:351
172376992116,4cyclictest179354-21kworker/u8:1+flush-8:020:47:441
172383992016,3cyclictest492579-21aten2_r5power_v00:32:302
172383992015,3cyclictest461838-21awk00:00:002
172383992013,5cyclictest451994-21gpgv23:50:012
17238399192,13cyclictest497401-21apt-get00:37:282
17238399192,12cyclictest184584-21apt-get19:22:272
172383991915,3cyclictest402874-21fschecks_count23:02:312
172383991915,2cyclictest0-21swapper/222:12:302
172383991914,4cyclictest0-21swapper/220:10:002
172383991911,6cyclictest425279-21tr23:22:342
172373991915,2cyclictest0-21swapper/021:32:370
1676922192,9sleep00-21swapper/019:07:260
17238399187,2cyclictest0-21swapper/221:50:012
172383991814,2cyclictest0-21swapper/220:42:472
172383991814,2cyclictest0-21swapper/219:32:462
172383991813,3cyclictest364928-21kthreadcore22:22:342
172383991813,3cyclictest0-21swapper/200:02:372
172383991811,5cyclictest335673-21tr21:52:352
172383991810,6cyclictest0-21swapper/221:59:592
1675602184,10sleep20-21swapper/219:05:442
17238399179,6cyclictest402168-21run-parts23:00:012
17238399179,6cyclictest275-21systemd-journal19:35:542
17238399172,12cyclictest421239-21ntpq23:17:452
17238399162,2cyclictest0-21swapper/220:16:172
17238399162,13cyclictest0-21swapper/223:51:182
172383991613,2cyclictest0-21swapper/222:40:462
172383991612,3cyclictest437804-21cut23:37:342
2424392150,2sleep3471rcuc/320:17:353
17238399158,5cyclictest434369-21tr23:32:372
172383991510,3cyclictest0-21swapper/219:47:352
4983972132,7sleep30-21swapper/300:37:363
4920542132,6sleep30-21swapper/300:30:013
4071642132,6sleep30-21swapper/323:05:023
3837562132,7sleep30-21swapper/322:42:353
3674972132,5sleep30-21swapper/322:25:013
3570832134,5sleep30-21swapper/322:12:453
3329842132,6sleep30-21swapper/321:50:023
3144862132,7sleep30-21swapper/321:32:363
3079392132,6sleep30-21swapper/321:25:023
2546602134,5sleep30-21swapper/320:32:333
2089202132,6sleep30-21swapper/319:45:023
1841672132,6sleep30-21swapper/319:20:023
4725692122,6sleep30-21swapper/300:12:363
4668442122,5sleep30-21swapper/300:05:013
4626772122,6sleep30-21swapper/300:02:333
4174502122,6sleep30-21swapper/323:17:343
4125052122,6sleep30-21swapper/323:12:283
4026142122,6sleep30-21swapper/323:02:293
3923662122,5sleep30-21swapper/322:50:013
3885942122,6sleep30-21swapper/322:47:363
3885942122,6sleep30-21swapper/322:47:363
3629412122,6sleep30-21swapper/322:22:243
3287522122,6sleep30-21swapper/321:47:333
3272102122,6sleep30-21swapper/321:42:483
3021452122,7sleep30-21swapper/321:17:393
2975172122,6sleep30-21swapper/321:12:463
2888592123,6sleep30-21swapper/321:07:323
2834622122,6sleep30-21swapper/321:00:063
2787452122,6sleep30-21swapper/320:57:293
2781002122,6sleep30-21swapper/320:52:563
2781002122,6sleep30-21swapper/320:52:563
2650172122,6sleep30-21swapper/320:42:363
2535932122,6sleep30-21swapper/320:30:003
2434402122,5sleep30-21swapper/320:20:013
2336502122,6sleep30-21swapper/320:10:023
2282972122,6sleep30-21swapper/320:02:473
2196472122,6sleep30-21swapper/319:57:343
2143562123,6sleep30-21swapper/319:52:323
2088702122,6sleep30-21swapper/319:44:543
1992062122,5sleep30-21swapper/319:35:023
1906552122,6sleep30-21swapper/319:27:363
1799902122,5sleep30-21swapper/319:17:333
1724542122,6sleep30-21swapper/319:10:023
4874522112,6sleep30-21swapper/300:26:443
4823592112,5sleep30-21swapper/300:20:023
4773912112,6sleep30-21swapper/300:17:293
4571192112,5sleep30-21swapper/323:55:023
4561962112,5sleep30-21swapper/323:52:413
4371952112,6sleep30-21swapper/323:36:483
4320512112,5sleep30-21swapper/323:30:023
4223502112,6sleep30-21swapper/323:21:563
3975972112,5sleep30-21swapper/322:57:043
3776462112,6sleep30-21swapper/322:35:083
3578022112,5sleep30-21swapper/322:15:023
3484292112,5sleep30-21swapper/322:07:323
3380462112,6sleep30-21swapper/321:55:243
3181392112,6sleep30-21swapper/321:36:463
3076242112,6sleep30-21swapper/321:22:493
2684522112,5sleep30-21swapper/320:45:013
2587522112,5sleep30-21swapper/320:35:023
2289242112,6sleep30-21swapper/320:06:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional