You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 11:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Mon Jun 22, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82362221820,2sleep3481ktimers/322:20:303
629833999183,6cyclictest685953-21kworker/u8:1+flush-8:020:10:360
6396302710,1sleep1639635-21tr19:15:361
629837997060,7cyclictest800430-21latency_hist22:00:011
629837997060,7cyclictest800430-21latency_hist22:00:001
629833996457,5cyclictest805031-21kworker/u8:3+flush-8:023:45:360
629837996253,6cyclictest1704890-21systemd-journal19:10:311
629833996250,9cyclictest651614-21latency_hist19:30:000
629833996053,5cyclictest685953-21kworker/u8:1+flush-8:020:40:320
629833995949,8cyclictest756136-21/usr/sbin/munin21:15:370
629833995851,4cyclictest528357-21kworker/u8:0+flush-8:021:00:240
629833995751,4cyclictest860350-21kworker/u8:1+flush-8:023:40:360
629833995746,8cyclictest675730-21ntpq19:50:350
629841995545,7cyclictest1704890-21systemd-journal21:00:012
629833995545,8cyclictest899022-21ntpq23:35:330
629833995544,8cyclictest3992462-21kworker/u8:1+flush-8:019:40:360
629837995448,4cyclictest670826-21ntpq19:45:341
629833995449,4cyclictest805031-21kworker/u8:3+flush-8:022:15:370
629837995342,8cyclictest839397-21ntpq22:35:331
629833995347,4cyclictest943640-21kworker/u8:2+events_unbound00:25:250
629833995346,5cyclictest745647-21kworker/u8:1+flush-8:021:05:300
629833995344,7cyclictest528357-21kworker/u8:0+flush-8:020:35:390
629833995245,5cyclictest943640-21kworker/u8:2+flush-8:000:30:360
629837995135,11cyclictest1704890-21systemd-journal23:36:031
629833995144,4cyclictest860350-21kworker/u8:1+events_unbound23:05:210
629833995142,7cyclictest1704890-21systemd-journal20:25:010
629837995044,3cyclictest860350-21kworker/u8:1+events_unbound00:35:361
629833995040,8cyclictest958497-21ntpq00:35:350
629833995040,8cyclictest918740-21ntpq23:55:320
629833995040,7cyclictest670712-21kworker/u8:2+flush-8:022:30:230
629833994945,3cyclictest860350-21kworker/u8:1+events_unbound23:10:360
629833994939,8cyclictest766325-21diskstats21:25:250
629837994843,4cyclictest670712-21kworker/u8:2+flush-8:020:55:371
629837994840,6cyclictest874982-21latency_hist23:15:011
629833994844,3cyclictest725695-21kworker/u8:3+flush-8:021:40:380
629833994640,4cyclictest805031-21kworker/u8:3+events_unbound23:20:330
629833994637,6cyclictest890047-21latency_hist23:30:010
629837994537,6cyclictest810797-21/usr/sbin/munin22:10:371
629837994535,8cyclictest670712-21kworker/u8:2+flush-8:020:50:361
629833994536,7cyclictest789624-21ntpq21:45:320
629833994536,6cyclictest691678-21latency_hist20:10:020
629841994438,4cyclictest821116-21kworker/u8:0+flush-8:022:50:352
629833994439,3cyclictest860350-21kworker/u8:1+events_unbound00:10:390
629833994438,4cyclictest725695-21kworker/u8:3+events_unbound21:20:220
629833994437,5cyclictest740103-21ntpq20:55:320
629833994437,5cyclictest528357-21kworker/u8:0+flush-8:019:55:350
629833994436,6cyclictest598327-21kworker/u8:3+events_unbound19:20:360
629833994436,6cyclictest3992462-21kworker/u8:1+events_unbound19:15:430
629833994433,7cyclictest670712-21kworker/u8:2+events_unbound20:25:200
629841994332,9cyclictest954382-21awk00:34:592
629833994337,4cyclictest821116-21kworker/u8:0+events_unbound22:45:220
629833994337,4cyclictest670712-21kworker/u8:2+events_unbound22:35:390
629833994336,5cyclictest805031-21kworker/u8:3+events_unbound22:20:340
629837994235,5cyclictest900204-21apt-get23:40:191
629833994235,5cyclictest860350-21kworker/u8:1+events_unbound23:00:220
629841994133,6cyclictest1704890-21systemd-journal20:10:002
629837994133,6cyclictest670712-21kworker/u8:2+flush-8:021:05:321
629837994133,5cyclictest1704890-21systemd-journal22:20:311
629833994137,3cyclictest943640-21kworker/u8:2+flush-8:000:20:360
629833994135,4cyclictest725695-21kworker/u8:3+flush-8:020:50:310
629833994133,6cyclictest3992462-21kworker/u8:1+flush-8:019:35:390
629833994132,6cyclictest914712-21latency_hist23:55:000
629841994034,4cyclictest913861-21kworker/u8:0+flush-8:000:13:092
629841994025,13cyclictest874582-21unixbench_singl23:10:382
629833994036,3cyclictest528357-21kworker/u8:0+events_unbound19:30:380
629837993930,7cyclictest869129-21ntpq23:05:331
629837993926,8cyclictest1704890-21systemd-journal22:40:321
629841993822,14cyclictest895469-21cpuspeed_turbos23:35:232
629837993832,4cyclictest944738-21/usr/sbin/munin00:25:331
629837993831,5cyclictest938656-21ntpq00:15:351
629837993831,5cyclictest741304-21/usr/sbin/munin21:00:321
629833993834,3cyclictest528357-21kworker/u8:0+events_unbound20:30:370
629833993831,5cyclictest745647-21kworker/u8:1+flush-8:021:10:370
629833993828,8cyclictest774759-21ntpq21:30:320
62938123824,8sleep30-21swapper/319:06:403
62984199372,13cyclictest751227-21apt-get21:10:212
629837993732,3cyclictest651633-21gpgv19:30:001
629837993731,4cyclictest943640-21kworker/u8:2+flush-8:000:23:141
629837993731,4cyclictest909775-21latency_hist23:50:011
629837993729,6cyclictest696862-21apt-get20:15:181
629833993733,3cyclictest919715-21kworker/u8:3+flush-8:000:05:410
629833993732,3cyclictest821116-21kworker/u8:0+events_unbound22:55:330
62984199362,14cyclictest761119-21apt-get21:20:222
629841993621,13cyclictest760835-21latency_hist21:20:002
629841993617,17cyclictest1704890-21systemd-journal19:39:322
629837993628,6cyclictest879242-21ntpq23:15:321
629837993528,5cyclictest642046-21apt-get19:20:201
629837993526,7cyclictest815759-21/usr/sbin/munin22:15:301
629833993531,3cyclictest670712-21kworker/u8:2+events_unbound20:15:370
629833993528,5cyclictest528357-21kworker/u8:0+events_unbound19:10:350
6293642353,9sleep10-21swapper/119:06:301
629841993424,8cyclictest1704890-21systemd-journal22:45:312
629841993417,15cyclictest651972-21cat19:30:022
629837993428,4cyclictest865045-21latency_hist23:05:011
629837993427,5cyclictest913870-21ntpq23:50:351
629837993426,6cyclictest701791-21/usr/sbin/munin20:20:361
629837993426,6cyclictest661701-21cron19:40:011
629837993425,7cyclictest924953-21apt-get00:05:191
629837993422,9cyclictest855163-21turbostat.cron22:55:001
629837993421,10cyclictest1704890-21systemd-journal22:00:321
629837993421,10cyclictest1704890-21systemd-journal22:00:311
629833993428,4cyclictest805031-21kworker/u8:3+flush-8:023:15:210
629833993424,8cyclictest685806-21ntpq20:00:320
629841993321,9cyclictest959359-21awk00:40:002
629837993326,5cyclictest756161-21apt-get21:15:191
629837993324,7cyclictest949719-21apt-get00:30:191
629837993322,8cyclictest1704890-21systemd-journal23:00:011
629837993315,5cyclictest1-21systemd20:37:311
629833993329,3cyclictest913861-21kworker/u8:0+events_unbound00:00:380
629833993329,3cyclictest670712-21kworker/u8:2+flush-8:022:10:220
629833993329,3cyclictest670712-21kworker/u8:2+events_unbound22:00:260
629833993329,3cyclictest670712-21kworker/u8:2+events_unbound22:00:250
629833993328,4cyclictest805031-21kworker/u8:3+flush-8:022:50:210
629833993328,4cyclictest805031-21kworker/u8:3+flush-8:022:05:430
629833993328,4cyclictest805031-21kworker/u8:3+flush-8:022:05:430
629833993326,5cyclictest821116-21kworker/u8:0+events_unbound22:40:360
629841993225,5cyclictest1704890-21systemd-journal22:05:002
629841993225,5cyclictest1704890-21systemd-journal22:05:002
62984199322,11cyclictest860387-21apt-get23:00:212
629841993116,13cyclictest835645-21aten2_r5power_c22:35:202
629841993113,2cyclictest0-21swapper/222:05:372
629841993113,2cyclictest0-21swapper/222:05:362
629837993123,6cyclictest726486-21apt-get20:45:181
629837993122,7cyclictest1704890-21systemd-journal20:05:001
629833993125,4cyclictest913861-21kworker/u8:0+events_unbound00:15:360
629833993125,4cyclictest598327-21kworker/u8:3+flush-8:019:49:020
62984199309,7cyclictest875754-21fschecks_count23:15:232
62984199303,8cyclictest885381-21apt-get23:25:202
629841993016,12cyclictest0-21swapper/221:40:342
629841993015,13cyclictest0-21swapper/220:10:302
629841993014,2cyclictest0-21swapper/220:20:382
629841993013,2cyclictest0-21swapper/221:45:342
629841993012,2cyclictest0-21swapper/220:29:292
629841993012,2cyclictest0-21swapper/219:20:312
62983799308,15cyclictest769901-21ntpq21:25:371
629837993024,4cyclictest794528-21ntpq21:50:311
62984199292,10cyclictest943649-21ntpq00:20:332
629841992914,2cyclictest0-21swapper/221:35:312
629841992912,3cyclictest0-21swapper/219:55:302
629837992922,5cyclictest765803-21latency_hist21:25:001
629837992921,6cyclictest1704890-21systemd-journal19:30:311
629837992916,8cyclictest1704890-21systemd-journal23:28:031
629837992911,5cyclictest0-21swapper/121:15:011
629833992925,3cyclictest860350-21kworker/u8:1+flush-8:023:30:380
629833992925,3cyclictest670712-21kworker/u8:2+events_unbound21:35:320
629833992925,3cyclictest670712-21kworker/u8:2+events_unbound20:45:360
629833992924,3cyclictest799460-21needreboot21:55:340
629833992924,3cyclictest799460-21needreboot21:55:330
629833992924,3cyclictest670712-21kworker/u8:2+flush-8:022:25:210
62984199287,7cyclictest743597-21tr21:00:292
62984199282,5cyclictest633980-21ntpq19:10:312
629841992824,2cyclictest731729-21fschecks_count20:50:202
629841992822,5cyclictest670712-21kworker/u8:2+flush-8:021:50:362
629841992813,2cyclictest944821-21aten2_r5power_e00:25:212
629841992813,2cyclictest0-21swapper/223:05:272
629837992823,3cyclictest881164-21irqrtprio23:20:241
629837992814,3cyclictest0-21swapper/120:10:301
629837992813,2cyclictest0-21swapper/123:30:271
629841992724,2cyclictest676165-21unixbench_multi19:50:392
62984199271,11cyclictest830901-21diskstats22:30:232
62983799277,5cyclictest775273-21grep21:30:401
62983799273,13cyclictest589-21runrttasks19:50:211
629837992722,2cyclictest0-21swapper/122:30:011
629837992719,6cyclictest919677-21latency_hist00:00:001
629837992719,6cyclictest710516-21ntpq20:25:341
62983799271,14cyclictest930129-21df_inode00:10:241
62983799270,16cyclictest834433-21ntpq22:30:311
62984199266,6cyclictest771072-21cut21:30:212
629841992622,2cyclictest820799-21aten2_r5power_e22:20:222
629841992622,2cyclictest667096-21aten2_r5power_v19:45:202
62983799268,4cyclictest690773-21ntp_kernel_pll_20:05:321
62983799267,5cyclictest921513-21cut00:00:281
62983799263,6cyclictest809915-21cat22:05:391
62983799263,6cyclictest809915-21cat22:05:381
629837992621,3cyclictest726241-21systemd-run20:45:011
629837992621,3cyclictest662225-21cpuspeed_turbos19:40:231
629837992619,1cyclictest161rcu_preempt22:45:241
629833992622,3cyclictest745647-21kworker/u8:1+events_unbound21:50:410
62984199257,2cyclictest8261772if_err_enp3s022:25:252
629841992511,2cyclictest0-21swapper/223:50:322
62983799259,2cyclictest0-21swapper/120:30:301
62983799251,5cyclictest784867-21taskset21:40:381
62983799250,10cyclictest776890-21grep21:35:271
62984199249,3cyclictest725339-21collect220:40:322
629841992420,2cyclictest726542-21aten2_r5power_e20:45:202
629841992413,2cyclictest0-21swapper/223:40:572
62983799243,11cyclictest30-21ksoftirqd/121:45:271
629841992320,2cyclictest890426-21aten2_r5power_v23:30:212
629837992319,2cyclictest0-21swapper/119:55:251
629841992117,2cyclictest0-21swapper/222:10:302
629841992116,4cyclictest939139-21unixbench_singl00:15:392
629841992113,5cyclictest1704890-21systemd-journal19:35:002
629841992017,2cyclictest770734-21cron21:29:592
629841992016,2cyclictest0-21swapper/222:45:012
6293662204,9sleep20-21swapper/219:06:312
629841991916,2cyclictest682410-21fschecks_time20:00:242
629841991915,2cyclictest0-21swapper/223:55:322
62984199190,17cyclictest800419-21cron22:00:002
62984199190,17cyclictest800419-21cron21:59:592
62984199189,7cyclictest714478-21tr20:30:322
629841991814,3cyclictest666712-21turbostat.cron19:45:012
629841991814,2cyclictest0-21swapper/223:45:222
629841991814,2cyclictest0-21swapper/200:05:402
62984199176,8cyclictest701737-21grep20:20:012
629841991713,2cyclictest0-21swapper/200:00:302
62984199169,5cyclictest885098-21cron23:25:012
62984199162,2cyclictest0-21swapper/219:15:172
629841991613,2cyclictest0-21swapper/221:06:572
629841991613,2cyclictest0-21swapper/220:35:172
629841991612,2cyclictest0-21swapper/223:00:012
629841991612,2cyclictest0-21swapper/222:15:242
6250092153,6sleep00-21swapper/019:05:070
8749702142,7sleep30-21swapper/323:15:003
7171492144,6sleep30-21swapper/320:35:293
7067562140,3chrt75-21kworker/3:1+events20:25:203
8305522132,6sleep30-21swapper/322:30:033
7663182133,6sleep30-21swapper/321:25:253
7594672132,7sleep30-21swapper/321:15:303
7056722134,6sleep30-21swapper/320:20:363
6967992132,6sleep30-21swapper/320:15:033
6467122132,6sleep30-21swapper/319:25:023
9500282122,6sleep30-21swapper/300:30:263
9451082122,6sleep30-21swapper/300:25:243
9406842122,6sleep30-21swapper/300:20:273
9357172123,5sleep30-21swapper/300:15:283
9342272122,6sleep30-21swapper/300:11:043
9238552122,6sleep30-21swapper/300:00:353
9154832123,6sleep30-21swapper/323:55:273
8999382122,5sleep30-21swapper/323:40:013
8958352122,6sleep30-21swapper/323:35:283
8901472122,5sleep30-21swapper/323:30:013
8896312122,6sleep30-21swapper/323:25:403
8813622123,5sleep30-21swapper/323:20:273
8650742122,6sleep30-21swapper/323:05:023
8645962122,6sleep30-21swapper/323:00:413
8542512122,6sleep30-21swapper/322:50:333
8461172122,6sleep30-21swapper/322:45:283
8406162122,6sleep30-21swapper/322:40:213
8363342122,6sleep30-21swapper/322:35:283
8162052123,5sleep30-21swapper/322:15:263
8151532122,6sleep30-21swapper/322:10:403
8058992122,6sleep30-21swapper/322:05:233
8058992122,6sleep30-21swapper/322:05:223
7957522122,6sleep30-21swapper/321:55:233
7957522122,6sleep30-21swapper/321:55:223
7858762122,6sleep30-21swapper/321:45:193
7646662122,6sleep30-21swapper/321:20:323
7517282122,6sleep30-21swapper/321:10:283
7417002122,6sleep30-21swapper/321:00:253
7410262122,5sleep30-21swapper/321:00:003
7264902123,6sleep30-21swapper/320:45:203
6906112122,6sleep30-21swapper/320:05:303
6775532122,6sleep30-21swapper/319:55:283
6717272122,6sleep30-21swapper/319:50:013
6620202122,6sleep30-21swapper/319:40:233
6558072122,6sleep30-21swapper/319:30:323
6458652122,6sleep30-21swapper/319:20:373
9546292112,5sleep30-21swapper/300:35:193
9247062112,5sleep30-21swapper/300:05:023
9103562110,7sleep30-21swapper/323:50:253
9050882112,5sleep30-21swapper/323:45:183
8758972112,5sleep30-21swapper/323:15:253
8554522112,5sleep30-21swapper/322:55:223
8276102112,5sleep30-21swapper/322:25:293
8007242112,5sleep30-21swapper/322:00:213
8007242112,5sleep30-21swapper/322:00:213
7905942112,5sleep30-21swapper/321:50:023
7822682112,6sleep30-21swapper/321:40:303
7763132112,6sleep30-21swapper/321:35:253
7750432112,5sleep30-21swapper/321:30:383
7465112112,5sleep30-21swapper/321:05:233
7311992112,5sleep30-21swapper/320:50:023
7215272112,5sleep30-21swapper/320:40:023
7155602112,6sleep30-21swapper/320:30:403
6928362112,5sleep30-21swapper/320:10:293
6820642112,5sleep30-21swapper/320:00:223
6708482112,5sleep30-21swapper/319:45:373
6614252112,6sleep30-21swapper/319:36:293
6407892112,5sleep30-21swapper/319:15:383
6341062112,5sleep30-21swapper/319:10:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional