You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 11:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 29, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
723599280,27cyclictest1308-21diskmemload22:55:490
7237992719,4cyclictest2697-21sh00:03:412
723599270,26cyclictest1308-21diskmemload22:18:510
7237992623,3cyclictest0-21swapper/200:29:392
7237992620,5cyclictest2235-21ssh22:06:422
7237992620,1cyclictest1308-21diskmemload23:20:422
7237992618,4cyclictest0-21swapper/223:40:272
723799260,25cyclictest0-21swapper/222:35:542
723799260,22cyclictest0-21swapper/223:32:432
723599260,21cyclictest0-21swapper/021:22:020
723599260,21cyclictest0-21swapper/000:11:180
723599260,1cyclictest0-21swapper/023:12:560
7239992523,1cyclictest17104-21rm22:50:413
723999250,24cyclictest0-21swapper/323:50:443
723999250,24cyclictest0-21swapper/300:35:543
7237992520,4cyclictest13993-21ssh21:49:432
7237992520,4cyclictest0-21swapper/223:15:172
723799250,24cyclictest26769-21idleruntime-cro22:30:012
723799250,24cyclictest1308-21diskmemload22:52:482
723799250,24cyclictest0-21swapper/223:29:512
723799250,24cyclictest0-21swapper/222:16:072
723799250,24cyclictest0-21swapper/221:54:222
723799250,21cyclictest0-21swapper/222:58:292
723799250,1cyclictest0-21swapper/222:11:102
723799250,0cyclictest0-21swapper/223:05:182
7236992523,1cyclictest0-21swapper/121:31:021
723699250,24cyclictest605-21avahi-daemon23:30:011
723699250,24cyclictest27817-21grep22:30:561
7235992520,4cyclictest1308-21diskmemload22:25:010
7235992520,4cyclictest1308-21diskmemload22:05:110
7235992519,1cyclictest8458-21cstates21:15:540
7235992518,1cyclictest0-21swapper/019:35:540
723599250,24cyclictest24722-21apt-get19:45:530
723599250,24cyclictest0-21swapper/023:32:450
723599250,24cyclictest0-21swapper/023:25:210
723599250,24cyclictest0-21swapper/022:43:520
723599250,24cyclictest0-21swapper/000:36:020
723599250,21cyclictest1308-21diskmemload21:40:310
723599250,21cyclictest0-21swapper/000:09:500
723599250,0cyclictest0-21swapper/021:32:490
7239992422,1cyclictest0-21swapper/321:56:393
723999240,23cyclictest1308-21diskmemload21:41:363
723999240,23cyclictest0-21swapper/320:30:553
723999240,0cyclictest7554-21ptp4l-jitter22:41:013
7237992422,1cyclictest18841-21perf20:40:002
7237992421,3cyclictest0-21swapper/223:52:472
7237992419,5cyclictest1308-21diskmemload22:24:532
723799240,24cyclictest0-21swapper/200:20:422
723799240,23cyclictest1308-21diskmemload22:00:352
723799240,23cyclictest0-21swapper/200:05:162
723799240,1cyclictest1308-21diskmemload21:31:372
723799240,0cyclictest0-21swapper/221:25:152
723799240,0cyclictest0-21swapper/219:45:022
723799240,0cyclictest0-21swapper/200:19:112
7236992424,0cyclictest0-21swapper/121:15:121
7236992422,1cyclictest25303-21sh23:55:521
7236992422,1cyclictest12032-21users00:11:041
723699240,24cyclictest0-21swapper/122:12:411
723699240,23cyclictest4200-21ssh23:06:511
723699240,23cyclictest32716-21kworker/u8:222:47:461
723699240,23cyclictest0-21swapper/121:25:521
723699240,23cyclictest0-21swapper/100:15:161
7235992420,3cyclictest0-21swapper/000:23:440
7235992420,0cyclictest0-21swapper/023:51:430
7235992419,1cyclictest8634-21df23:40:550
7235992419,1cyclictest30373-21ssh22:03:300
7235992419,1cyclictest0-21swapper/022:11:280
723599240,23cyclictest1308-21diskmemload22:51:100
723599240,23cyclictest0-21swapper/022:32:230
723599240,22cyclictest313-21systemd-journal19:25:010
723599240,1cyclictest0-21swapper/021:38:000
723599240,0cyclictest1308-21diskmemload23:06:000
723599240,0cyclictest0-21swapper/022:35:520
723599240,0cyclictest0-21swapper/021:11:220
7239992323,0cyclictest0-21swapper/323:35:473
7239992323,0cyclictest0-21swapper/322:25:363
7239992323,0cyclictest0-21swapper/321:49:123
7239992323,0cyclictest0-21swapper/321:24:563
7239992323,0cyclictest0-21swapper/300:21:583
7239992323,0cyclictest0-21swapper/300:04:543
7239992321,1cyclictest1308-21diskmemload23:45:583
7239992321,1cyclictest12439-21ssh23:44:213
7239992321,1cyclictest0-21swapper/322:32:233
723999231,21cyclictest34-21ksoftirqd/321:05:013
723999230,2cyclictest32679-21ssh22:35:163
723999230,2cyclictest11331-21ssh23:14:053
723999230,23cyclictest34-21ksoftirqd/300:27:223
723999230,23cyclictest1308-21diskmemload22:04:363
723999230,23cyclictest0-21swapper/323:21:123
723999230,23cyclictest0-21swapper/321:13:143
723999230,22cyclictest5392-21ssh23:08:313
723999230,22cyclictest4756-21apt-get20:10:523
723999230,22cyclictest29932-21latency_hist21:35:003
723999230,22cyclictest26817-21apt-get20:55:543
723999230,22cyclictest17118-21sh23:19:203
723999230,22cyclictest16179-21sh22:20:263
723999230,22cyclictest14030-21ssh22:46:373
723999230,22cyclictest1308-21diskmemload22:11:463
723999230,0cyclictest0-21swapper/323:30:303
723999230,0cyclictest0-21swapper/322:56:393
723999230,0cyclictest0-21swapper/300:11:393
7237992323,0cyclictest1308-21diskmemload22:34:292
7237992323,0cyclictest0-21swapper/223:55:102
7237992323,0cyclictest0-21swapper/223:01:012
7237992323,0cyclictest0-21swapper/221:43:352
7237992323,0cyclictest0-21swapper/200:14:112
7237992320,3cyclictest0-21swapper/223:46:362
7237992320,3cyclictest0-21swapper/222:45:052
7237992320,3cyclictest0-21swapper/200:32:582
7237992319,3cyclictest0-21swapper/223:11:202
723799230,2cyclictest0-21swapper/219:40:002
723799230,22cyclictest5556-21ssh23:37:342
723799230,22cyclictest10114-21ssh22:44:022
723799230,0cyclictest0-21swapper/200:39:432
7236992323,0cyclictest0-21swapper/122:00:201
7236992321,1cyclictest1308-21diskmemload00:39:081
7236992321,1cyclictest0-21swapper/123:44:491
7236992321,1cyclictest0-21swapper/100:32:091
7236992321,1cyclictest0-21swapper/100:07:091
723699230,2cyclictest31327-21munin-run21:05:011
723699230,2cyclictest1834-21latency_hist23:35:001
723699230,23cyclictest1308-21diskmemload23:10:321
723699230,22cyclictest8013-21ssh21:44:161
723699230,22cyclictest24424-21ssh22:26:471
723699230,22cyclictest20826-21ssh22:53:261
723699230,22cyclictest0-21swapper/122:40:031
723699230,22cyclictest0-21swapper/121:45:561
723699230,22cyclictest0-21swapper/100:00:031
723699230,0cyclictest1308-21diskmemload21:12:181
723699230,0cyclictest0-21swapper/123:48:411
723699230,0cyclictest0-21swapper/123:37:351
7235992323,0cyclictest0-21swapper/019:25:540
7235992323,0cyclictest0-21swapper/000:18:180
7235992322,1cyclictest62550irq/127-eno123:37:530
7235992322,1cyclictest62550irq/127-eno100:25:020
7235992321,2cyclictest0-21swapper/021:57:310
723599232,0cyclictest62550irq/127-eno121:51:560
723599230,23cyclictest0-21swapper/023:23:300
723599230,22cyclictest6846-21munin-run20:15:010
723599230,22cyclictest18865-21munin-run20:40:000
723599230,22cyclictest0-21swapper/022:45:400
723599230,0cyclictest1308-21diskmemload22:25:060
723599230,0cyclictest0-21swapper/023:00:160
723599230,0cyclictest0-21swapper/021:27:080
723599230,0cyclictest0-21swapper/000:02:200
7239992222,0cyclictest1308-21diskmemload23:57:363
7239992222,0cyclictest0-21swapper/322:05:153
7239992220,1cyclictest0-21swapper/300:15:103
723999220,22cyclictest1308-21diskmemload23:02:063
723999220,21cyclictest4374-21sh00:05:363
723999220,21cyclictest34-21ksoftirqd/323:26:563
723999220,21cyclictest31634-21cron20:00:003
723999220,21cyclictest1308-21diskmemload21:25:373
723999220,21cyclictest12328-21apt-get19:20:533
723999220,21cyclictest11648-21turbostat20:25:013
723999220,21cyclictest0-21swapper/320:55:003
723999220,1cyclictest0-21swapper/320:45:553
723999220,0cyclictest151rcu_preempt00:30:063
723999220,0cyclictest0-21swapper/322:16:563
7237992222,0cyclictest0-21swapper/221:55:052
723799220,21cyclictest2361-21apt-get20:05:542
723799220,21cyclictest19186-21apt-get20:40:532
723799220,21cyclictest14042-21turbostat.cron20:30:002
7236992222,0cyclictest1308-21diskmemload21:37:191
7236992222,0cyclictest0-21swapper/123:20:481
7236992222,0cyclictest0-21swapper/123:16:251
7236992222,0cyclictest0-21swapper/122:56:181
7236992221,1cyclictest2223-21ssh22:06:411
7236992221,1cyclictest1308-21diskmemload23:00:351
7236992221,1cyclictest0-21swapper/122:37:411
7236992221,1cyclictest0-21swapper/122:15:421
7236992220,1cyclictest17380-21/usr/sbin/munin22:20:571
7236992220,1cyclictest14274-21apt-get21:50:021
723699220,21cyclictest21580-21apt-get20:45:541
723699220,21cyclictest0-21swapper/123:50:571
723699220,21cyclictest0-21swapper/121:20:231
723699220,21cyclictest0-21swapper/120:30:001
723699220,21cyclictest0-21swapper/120:05:531
723699220,1cyclictest0-21swapper/100:25:011
723699220,0cyclictest0-21swapper/100:20:021
723599220,22cyclictest0-21swapper/023:48:070
723599220,21cyclictest62550irq/127-eno123:55:540
723599220,21cyclictest0-21swapper/020:30:550
723599220,0cyclictest0-21swapper/023:15:570
7239992119,1cyclictest15174-21ssh21:50:283
7239992118,2cyclictest29231-21cron19:55:003
723999210,21cyclictest0-21swapper/321:15:083
7237992121,0cyclictest0-21swapper/220:00:542
7237992121,0cyclictest0-21swapper/219:50:532
7237992120,1cyclictest0-21swapper/221:20:342
7237992118,2cyclictest31637-21tr20:00:002
723799210,0cyclictest0-21swapper/221:35:182
7236992121,0cyclictest1308-21diskmemload21:55:071
723699210,20cyclictest0-21swapper/121:05:531
723699210,20cyclictest0-21swapper/119:35:541
7239992020,0cyclictest19518-21apt-get19:35:543
723999200,0cyclictest0-21swapper/319:10:533
7237992020,0cyclictest14722-21apt-get19:25:542
7237992020,0cyclictest0-21swapper/220:55:022
7237992020,0cyclictest0-21swapper/219:30:542
7237992020,0cyclictest0-21swapper/219:15:002
7237992018,1cyclictest31342-21apt-get21:05:012
723799200,20cyclictest0-21swapper/221:05:532
723799200,20cyclictest0-21swapper/220:45:542
723799200,0cyclictest0-21swapper/220:20:542
7236992020,0cyclictest0-21swapper/119:45:531
7236992018,1cyclictest16435-21cron20:35:001
723699200,20cyclictest0-21swapper/120:50:521
723699200,0cyclictest7158-21apt-get20:15:541
7235992020,0cyclictest0-21swapper/019:15:530
7235992019,0cyclictest0-21swapper/020:05:020
7235992018,1cyclictest1348-21basename21:10:010
723599200,0cyclictest0-21swapper/019:50:530
7237991917,1cyclictest14411-21awk19:25:012
7236991917,1cyclictest21268-21perf20:45:001
723699190,18cyclictest605-21avahi-daemon19:35:011
7235991919,0cyclictest0-21swapper/020:45:540
7235991917,2cyclictest31308-21cron21:05:010
7235991917,1cyclictest31668-21basename20:00:000
7239991818,0cyclictest0-21swapper/321:05:013
7239991818,0cyclictest0-21swapper/320:40:543
7239991818,0cyclictest0-21swapper/320:05:543
7239991818,0cyclictest0-21swapper/319:40:543
7239991818,0cyclictest0-21swapper/319:15:533
7239991816,1cyclictest9264-21awk20:20:013
7236991818,0cyclictest0-21swapper/120:35:541
7236991817,1cyclictest1647-21munin-run20:05:001
7236991817,1cyclictest0-21swapper/120:55:531
7235991818,0cyclictest0-21swapper/020:55:540
7239991717,0cyclictest0-21swapper/319:45:533
723799174,2cyclictest0-21swapper/220:31:012
7237991717,0cyclictest0-21swapper/220:15:532
7236991717,0cyclictest0-21swapper/119:15:531
723699170,1cyclictest14388-21latency_hist19:25:011
7235991717,0cyclictest0-21swapper/020:20:540
723799162,5cyclictest0-21swapper/219:41:002
7237991615,1cyclictest9907-21apt-get19:15:522
7236991616,0cyclictest0-21swapper/119:40:531
7236991614,1cyclictest9588-21apt19:15:001
7235991616,0cyclictest0-21swapper/020:25:530
7235991615,1cyclictest19205-21perf19:35:010
7239991515,0cyclictest0-21swapper/320:00:543
7239991513,1cyclictest17120-21apt-get19:30:543
7239991513,1cyclictest16792-21perf19:30:013
723999150,7cyclictest0-21swapper/320:35:533
7237991515,0cyclictest23972-21apt-get20:50:532
7236991515,0cyclictest0-21swapper/119:25:541
723599150,1cyclictest0-21swapper/020:40:590
723599150,1cyclictest0-21swapper/020:00:560
723599150,14cyclictest0-21swapper/019:40:190
723999140,14cyclictest0-21swapper/320:27:583
7237991414,0cyclictest0-21swapper/220:10:522
7236991414,0cyclictest0-21swapper/120:20:541
7236991414,0cyclictest0-21swapper/120:10:311
723699140,0cyclictest0-21swapper/119:55:081
7235991414,0cyclictest0-21swapper/020:15:040
723599140,14cyclictest0-21swapper/020:52:240
723599140,0cyclictest0-21swapper/019:11:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional