You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 09:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Sep 11, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2006299290,28cyclictest0-21swapper/023:46:590
2006299280,27cyclictest6646-21latency_hist23:30:000
2006299280,24cyclictest13664-21diskmemload23:37:290
20062992623,3cyclictest0-21swapper/000:07:130
20062992621,4cyclictest12076-21apt-get22:07:000
2006299260,26cyclictest0-21swapper/022:42:020
2006999250,24cyclictest1299-21ntp_states21:27:063
2006999250,24cyclictest1299-21ntp_states21:27:063
2006799252,2cyclictest2195-21sh22:56:572
20067992521,4cyclictest0-21swapper/223:54:582
2006799250,24cyclictest0-21swapper/221:36:262
2006699250,24cyclictest29079-21ssh22:51:531
20062992523,1cyclictest16312-21expr00:37:010
20062992522,3cyclictest13664-21diskmemload21:49:430
20062992520,4cyclictest13664-21diskmemload21:26:340
20062992520,4cyclictest13664-21diskmemload21:26:340
2006299250,24cyclictest26553-21ssh22:48:400
2006299250,24cyclictest0-21swapper/022:52:080
2006299250,24cyclictest0-21swapper/021:56:100
2006299250,23cyclictest0-21swapper/000:28:030
20069992422,1cyclictest13664-21diskmemload00:04:563
2006999240,2cyclictest30795-21ssh22:22:363
2006999240,23cyclictest13664-21diskmemload22:55:123
2006999240,23cyclictest0-21swapper/323:49:223
2006999240,23cyclictest0-21swapper/322:28:293
2006999240,23cyclictest0-21swapper/321:53:593
2006999240,1cyclictest13664-21diskmemload21:40:373
2006999240,0cyclictest4491-21apt-get20:51:593
20067992423,1cyclictest0-21swapper/221:16:012
2006799242,21cyclictest13664-21diskmemload22:44:402
2006799240,24cyclictest0-21swapper/223:59:552
20066992421,2cyclictest31996-21grep00:22:001
2006699240,24cyclictest0-21swapper/123:42:291
2006699240,24cyclictest0-21swapper/100:01:531
2006699240,23cyclictest0-21swapper/123:16:581
2006699240,0cyclictest0-21swapper/121:18:351
20062992421,3cyclictest0-21swapper/021:22:070
20062992421,2cyclictest3317-21sh22:27:080
20062992421,2cyclictest26278-21ssh22:19:070
2006299240,24cyclictest9936-21ssh00:31:270
2006299240,23cyclictest13664-21diskmemload22:36:340
2006299240,23cyclictest13664-21diskmemload21:14:590
2006299240,23cyclictest0-21swapper/023:18:120
2006299240,23cyclictest0-21swapper/023:06:430
20069992323,0cyclictest13664-21diskmemload22:07:263
20069992323,0cyclictest0-21swapper/323:10:363
20069992323,0cyclictest0-21swapper/323:06:013
20069992323,0cyclictest0-21swapper/322:35:133
20069992323,0cyclictest0-21swapper/321:10:343
20069992323,0cyclictest0-21swapper/319:51:573
20069992321,1cyclictest16484-21cron20:10:013
20069992321,1cyclictest0-21swapper/323:55:243
20069992321,1cyclictest0-21swapper/300:27:003
20069992320,2cyclictest31219-21ssh00:21:383
20069992320,2cyclictest23172-21sh00:13:193
20069992320,2cyclictest10214-21ssh22:33:573
2006999230,23cyclictest0-21swapper/321:15:243
2006999230,1cyclictest0-21swapper/319:46:583
2006999230,0cyclictest13664-21diskmemload21:55:133
2006999230,0cyclictest0-21swapper/323:53:223
20067992323,0cyclictest0-21swapper/222:51:242
20067992323,0cyclictest0-21swapper/222:45:582
20067992322,1cyclictest13664-21diskmemload23:35:362
20067992321,1cyclictest21341-21ssh21:45:242
20067992320,2cyclictest9548-21ssh22:03:522
2006799230,23cyclictest13664-21diskmemload21:12:232
2006799230,22cyclictest834-21ssh22:25:512
2006799230,22cyclictest7552-21sh23:01:422
2006799230,22cyclictest606-21dbus-daemon21:00:012
2006799230,22cyclictest29551-21apt-get23:21:572
2006799230,22cyclictest2931-21sh21:28:302
2006799230,22cyclictest2931-21sh21:28:302
2006799230,22cyclictest26645-21ssh21:50:092
2006799230,22cyclictest26530-21ssh23:17:572
2006799230,22cyclictest2545-21ssh23:26:532
2006799230,22cyclictest17333-21ssh23:10:142
2006799230,22cyclictest13664-21diskmemload22:11:062
2006799230,22cyclictest0-21swapper/223:46:582
2006799230,22cyclictest0-21swapper/200:29:462
2006799230,0cyclictest13664-21diskmemload21:58:472
2006799230,0cyclictest13664-21diskmemload00:05:402
2006799230,0cyclictest0-21swapper/221:30:102
2006799230,0cyclictest0-21swapper/221:20:202
2006799230,0cyclictest0-21swapper/200:15:362
20066992323,0cyclictest0-21swapper/122:56:071
20066992323,0cyclictest0-21swapper/122:31:431
20066992323,0cyclictest0-21swapper/122:25:111
20066992323,0cyclictest0-21swapper/122:11:431
20066992323,0cyclictest0-21swapper/100:36:281
20066992322,1cyclictest13664-21diskmemload21:42:071
20066992322,1cyclictest0-21swapper/121:45:111
20066992321,1cyclictest18495-21sh23:11:581
20066992321,1cyclictest0-21swapper/100:09:261
2006699230,2cyclictest4636-21ssh21:30:041
2006699230,23cyclictest13664-21diskmemload21:58:461
2006699230,23cyclictest0-21swapper/123:23:291
2006699230,22cyclictest8181-21df_inode23:02:021
2006699230,22cyclictest7098-21ssh23:30:311
2006699230,22cyclictest27287-21rm21:50:581
2006699230,22cyclictest21873-21ssh22:15:221
2006699230,22cyclictest14491-21ssh22:08:041
2006699230,22cyclictest12934-21ssh00:33:151
2006699230,1cyclictest17599-21ssh21:12:191
2006699230,0cyclictest0-21swapper/123:52:271
20062992323,0cyclictest0-21swapper/023:11:230
20062992323,0cyclictest0-21swapper/022:24:490
20062992321,2cyclictest0-21swapper/021:15:190
20062992321,1cyclictest0-21swapper/021:41:520
20062992321,1cyclictest0-21swapper/021:36:220
20062992320,3cyclictest0-21swapper/023:20:590
20062992319,3cyclictest2056-21ssh00:23:500
20062992319,3cyclictest13664-21diskmemload22:14:310
2006299230,23cyclictest0-21swapper/023:02:560
2006299230,23cyclictest0-21swapper/022:03:530
2006299230,22cyclictest6614-21ssh22:31:110
2006299230,22cyclictest606-21dbus-daemon20:45:010
2006299230,22cyclictest26714-21/usr/sbin/munin00:17:050
2006299230,22cyclictest13664-21diskmemload21:50:550
2006299230,22cyclictest0-21swapper/023:56:270
2006299230,22cyclictest0-21swapper/000:13:500
2006299230,1cyclictest4308-21apt-get20:50:020
2006299230,1cyclictest2429-21cron23:55:010
2006299230,0cyclictest0-21swapper/023:31:340
2006299230,0cyclictest0-21swapper/020:22:000
20069992222,0cyclictest0-21swapper/300:35:023
20069992220,1cyclictest13664-21diskmemload22:50:373
20069992220,1cyclictest13355-21sh23:36:073
20069992220,1cyclictest0-21swapper/323:24:023
20069992220,1cyclictest0-21swapper/322:45:033
20069992219,2cyclictest22984-21sh22:16:573
2006999221,1cyclictest21335-21sh21:45:233
2006999220,22cyclictest0-21swapper/321:21:543
2006999220,21cyclictest606-21dbus-daemon21:35:013
2006999220,21cyclictest25033-21ssh00:15:343
2006999220,21cyclictest17315-21sh00:07:403
2006999220,21cyclictest13664-21diskmemload23:40:473
2006999220,21cyclictest0-21swapper/323:31:453
2006999220,21cyclictest0-21swapper/322:41:483
2006999220,21cyclictest0-21swapper/322:10:323
2006999220,21cyclictest0-21swapper/319:26:573
2006999220,21cyclictest0-21swapper/300:30:013
2006999220,1cyclictest4451-21munin-run19:45:003
2006999220,1cyclictest0-21swapper/323:25:493
2006999220,1cyclictest0-21swapper/323:15:023
2006999220,1cyclictest0-21swapper/323:02:563
20067992222,0cyclictest13664-21diskmemload00:13:342
20067992222,0cyclictest0-21swapper/223:31:452
20067992222,0cyclictest0-21swapper/222:21:572
20067992221,1cyclictest1697-21apt-get20:46:582
20067992221,1cyclictest14744-21ssh23:07:092
20067992221,1cyclictest13664-21diskmemload22:33:242
20067992220,1cyclictest14054-21grep20:05:012
20067992220,1cyclictest0-21swapper/222:06:002
2006799220,22cyclictest13664-21diskmemload00:00:312
2006799220,21cyclictest606-21dbus-daemon19:20:012
2006799220,21cyclictest15629-21ssh21:40:132
2006799220,21cyclictest13664-21diskmemload22:15:582
2006799220,21cyclictest0-21swapper/200:35:062
2006799220,21cyclictest0-21swapper/200:20:292
2006799220,1cyclictest18392-21ssh23:40:222
2006799220,1cyclictest0-21swapper/222:37:062
2006799220,0cyclictest0-21swapper/220:50:022
2006799220,0cyclictest0-21swapper/219:46:582
20066992222,0cyclictest13664-21diskmemload21:20:301
20066992222,0cyclictest0-21swapper/123:26:151
20066992222,0cyclictest0-21swapper/121:37:501
20066992222,0cyclictest0-21swapper/119:26:581
20066992221,1cyclictest0-21swapper/123:45:011
20066992220,2cyclictest27043-21ssh22:49:171
20066992220,1cyclictest3936-21sh23:56:521
2006699220,22cyclictest0-21swapper/123:36:501
2006699220,22cyclictest0-21swapper/100:26:471
2006699220,22cyclictest0-21swapper/100:15:271
2006699220,21cyclictest3954-21grep21:30:001
2006699220,21cyclictest3954-21grep21:30:001
2006699220,21cyclictest22836-21apt-get19:16:591
2006699220,21cyclictest19500-21ssh00:10:331
2006699220,21cyclictest12050-21apt-get20:01:571
2006699220,21cyclictest10372-21ls22:05:001
2006699220,21cyclictest0-21swapper/122:20:201
2006699220,1cyclictest30045-21apt-get19:31:581
2006699220,1cyclictest18026-21ssh22:41:461
20062992220,2cyclictest0-21swapper/022:57:480
20062992220,1cyclictest606-21dbus-daemon20:50:010
20062992220,1cyclictest0-21swapper/023:41:040
2006299220,21cyclictest14043-21turbostat.cron20:05:010
2006299220,21cyclictest0-21swapper/021:31:590
2006299220,21cyclictest0-21swapper/019:51:580
2006299220,1cyclictest12377-21ssh00:03:230
20069992119,1cyclictest26506-21apt-get20:31:583
20069992119,1cyclictest14057-21basename20:05:013
2006999210,20cyclictest24108-21apt-get20:26:583
20067992119,1cyclictest8941-21apt-get00:30:022
2006699210,20cyclictest0-21swapper/120:46:581
2006699210,1cyclictest0-21swapper/119:45:001
20062992119,1cyclictest0-21swapper/019:45:000
2006299210,21cyclictest0-21swapper/019:11:570
2006299210,20cyclictest0-21swapper/019:46:580
2006299210,0cyclictest0-21swapper/020:15:000
20069992020,0cyclictest6888-21apt-get20:57:003
20069992020,0cyclictest0-21swapper/320:16:583
20069992019,0cyclictest0-21swapper/319:16:593
20069992018,1cyclictest13662-21cron21:10:003
2006999200,0cyclictest30045-21apt-get19:31:583
2006999200,0cyclictest0-21swapper/319:56:593
20067992020,0cyclictest27648-21apt-get19:26:582
20067992020,0cyclictest0-21swapper/219:31:582
20067992019,1cyclictest606-21dbus-daemon19:25:002
20066992020,0cyclictest0-21swapper/120:11:591
20066992019,0cyclictest0-21swapper/120:31:581
2006699200,20cyclictest0-21swapper/120:41:581
2006699200,0cyclictest0-21swapper/120:36:581
20062992020,0cyclictest0-21swapper/021:01:590
20062992020,0cyclictest0-21swapper/019:16:590
20062992019,1cyclictest0-21swapper/019:26:580
20062992018,1cyclictest0-21swapper/019:21:580
2006299200,20cyclictest0-21swapper/019:36:580
2006299200,19cyclictest0-21swapper/020:25:120
2006299200,0cyclictest0-21swapper/020:06:590
20069991919,0cyclictest0-21swapper/320:41:593
20069991919,0cyclictest0-21swapper/320:22:003
20069991918,0cyclictest0-21swapper/319:36:573
20067991919,0cyclictest0-21swapper/220:26:582
20067991917,1cyclictest30889-21apt-get20:40:022
20066991919,0cyclictest14445-21apt-get20:06:591
20066991919,0cyclictest0-21swapper/120:57:001
20066991918,0cyclictest0-21swapper/119:51:581
20062991919,0cyclictest0-21swapper/019:31:570
2006999180,0cyclictest0-21swapper/320:11:593
20067991818,0cyclictest0-21swapper/221:01:592
20067991818,0cyclictest0-21swapper/220:16:582
20067991816,1cyclictest9235-21dump-pmu-power19:55:012
20066991818,0cyclictest0-21swapper/119:21:581
20066991818,0cyclictest0-21swapper/119:11:561
20069991717,0cyclictest9304-21apt-get21:01:593
20069991715,1cyclictest27224-21idleruntime-cro19:25:003
20067991717,0cyclictest11697-21apt-get21:06:582
20067991717,0cyclictest0-21swapper/220:31:582
20067991717,0cyclictest0-21swapper/219:36:582
20067991716,1cyclictest20441-21apt-get19:11:562
20062991714,2cyclictest26720-21cstates20:31:590
20067991616,0cyclictest16895-21apt-get20:11:592
20066991614,1cyclictest0-21swapper/120:50:021
20062991614,1cyclictest8606-21users20:57:090
20069991515,0cyclictest0-21swapper/320:46:583
20069991513,1cyclictest30924-21awk20:40:003
20067991515,0cyclictest0-21swapper/219:41:582
20066991515,0cyclictest0-21swapper/121:10:001
20066991513,1cyclictest23847-21munin-run20:25:001
20062991513,1cyclictest13666-21dump-pmu-power21:10:000
2006999140,14cyclictest0-21swapper/319:10:463
20067991414,0cyclictest0-21swapper/220:05:382
2006799140,14cyclictest0-21swapper/220:35:472
2006799140,14cyclictest0-21swapper/220:20:232
2006799140,14cyclictest0-21swapper/219:55:222
20066991414,0cyclictest0-21swapper/120:15:051
20066991414,0cyclictest0-21swapper/119:35:241
2006699140,14cyclictest0-21swapper/121:00:391
2006699140,14cyclictest0-21swapper/119:55:081
2006699140,0cyclictest0-21swapper/120:26:501
2006699140,0cyclictest0-21swapper/119:45:131
20062991414,0cyclictest0-21swapper/020:36:320
2006299140,14cyclictest0-21swapper/019:55:360
2006299140,0cyclictest0-21swapper/020:15:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional