You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 12, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20989992624,1cyclictest0-21swapper/122:06:571
2099799250,24cyclictest15039-21diskmemload22:37:293
2099299250,1cyclictest17982-21sh00:33:392
20989992523,1cyclictest0-21swapper/100:23:431
2098999250,24cyclictest0-21swapper/123:43:591
2098799252,1cyclictest25791-21awk20:25:000
2098799250,24cyclictest14046-21apt-get00:01:570
2098799250,24cyclictest0-21swapper/022:57:370
2098799250,24cyclictest0-21swapper/021:37:070
2098799250,24cyclictest0-21swapper/000:30:400
20997992424,0cyclictest0-21swapper/300:10:143
20997992422,1cyclictest2405-21munin-run22:25:013
2099799240,24cyclictest0-21swapper/323:32:083
2099799240,23cyclictest566-21ssh00:17:493
2099799240,23cyclictest0-21swapper/322:11:553
2099799240,1cyclictest15039-21diskmemload00:36:543
20992992423,1cyclictest16263-21sh21:39:232
20992992423,1cyclictest15039-21diskmemload22:20:292
20992992423,1cyclictest0-21swapper/200:06:092
2099299240,23cyclictest20173-21ssh23:08:572
2099299240,23cyclictest15039-21diskmemload23:00:032
2099299240,23cyclictest15039-21diskmemload23:00:032
2099299240,23cyclictest15039-21diskmemload22:01:502
2099299240,23cyclictest0-21swapper/222:47:062
2099299240,23cyclictest0-21swapper/222:11:242
2099299240,1cyclictest6372-21ssh21:59:162
20989992424,0cyclictest0-21swapper/121:53:261
20989992424,0cyclictest0-21swapper/100:03:591
20989992423,1cyclictest0-21swapper/122:40:371
20989992422,1cyclictest28759-21ssh22:47:221
2098999240,24cyclictest12137-21diskmemload22:04:391
2098999240,24cyclictest0-21swapper/123:49:331
2098999240,24cyclictest0-21swapper/122:57:451
2098999240,24cyclictest0-21swapper/100:30:051
2098999240,23cyclictest6727-21sh23:55:011
2098999240,23cyclictest15039-21diskmemload23:07:351
2098999240,23cyclictest15039-21diskmemload21:42:571
2098999240,23cyclictest1177-21sh00:18:431
2098999240,23cyclictest0-21swapper/123:29:171
2098999240,23cyclictest0-21swapper/122:52:131
2098999240,23cyclictest0-21swapper/100:06:561
2098999240,1cyclictest0-21swapper/123:36:021
2098999240,0cyclictest0-21swapper/121:11:111
20987992424,0cyclictest0-21swapper/021:20:000
20987992423,1cyclictest15039-21diskmemload22:16:330
20987992423,1cyclictest0-21swapper/000:06:390
2098799240,24cyclictest0-21swapper/023:43:380
2098799240,23cyclictest0-21swapper/023:38:080
2098799240,23cyclictest0-21swapper/023:31:530
2098799240,23cyclictest0-21swapper/021:49:410
2098799240,1cyclictest15039-21diskmemload00:16:060
2098799240,0cyclictest0-21swapper/022:51:580
2098799240,0cyclictest0-21swapper/021:52:150
20997992323,0cyclictest0-21swapper/323:16:083
20997992323,0cyclictest0-21swapper/321:22:483
20997992323,0cyclictest0-21swapper/321:11:243
20997992321,1cyclictest0-21swapper/321:59:103
20997992320,2cyclictest607-21in:imuxsock20:35:003
20997992320,2cyclictest27260-21sh23:44:103
2099799230,23cyclictest0-21swapper/323:35:313
2099799230,23cyclictest0-21swapper/322:27:503
2099799230,23cyclictest0-21swapper/321:42:373
2099799230,23cyclictest0-21swapper/321:17:413
2099799230,22cyclictest9283-21ssh21:32:303
2099799230,22cyclictest30946-21awk19:30:013
2099799230,22cyclictest27416-21sh22:17:373
2099799230,22cyclictest26136-21ssh23:14:263
2099799230,22cyclictest22994-21perf20:20:003
2099799230,22cyclictest18210-21awk20:10:013
2099799230,22cyclictest15039-21diskmemload21:51:193
2099799230,22cyclictest15039-21diskmemload21:46:323
2099799230,22cyclictest15039-21diskmemload00:02:043
2099799230,0cyclictest15039-21diskmemload23:52:393
2099799230,0cyclictest0-21swapper/323:57:093
2099799230,0cyclictest0-21swapper/300:30:563
20992992323,0cyclictest0-21swapper/223:52:152
20992992323,0cyclictest0-21swapper/223:11:572
20992992322,1cyclictest15039-21diskmemload21:21:122
20992992321,1cyclictest15856-21sh21:10:432
20992992321,1cyclictest12649-21cron21:05:012
20992992321,1cyclictest0-21swapper/223:45:012
20992992318,1cyclictest0-21swapper/200:27:022
2099299230,23cyclictest0-21swapper/223:21:042
2099299230,23cyclictest0-21swapper/222:38:142
2099299230,23cyclictest0-21swapper/221:45:412
2099299230,23cyclictest0-21swapper/221:42:512
2099299230,23cyclictest0-21swapper/221:34:342
2099299230,22cyclictest5153-21phc2sys22:27:052
2099299230,22cyclictest28330-21sh21:50:012
2099299230,22cyclictest22968-21ssh22:42:102
2099299230,22cyclictest17364-21ssh23:35:402
2099299230,1cyclictest15039-21diskmemload00:11:122
2099299230,0cyclictest15039-21diskmemload00:17:422
2099299230,0cyclictest0-21swapper/223:45:252
2099299230,0cyclictest0-21swapper/222:55:192
2099299230,0cyclictest0-21swapper/222:31:162
20989992323,0cyclictest0-21swapper/100:35:051
20989992321,1cyclictest23820-21apt-get20:21:571
20989992321,1cyclictest0-21swapper/123:13:281
20989992321,1cyclictest0-21swapper/121:15:161
2098999231,1cyclictest14908-21sh22:36:411
2098999230,2cyclictest3156-21ssh22:25:511
2098999230,22cyclictest3247-21expr21:57:011
2098999230,22cyclictest26864-21sh23:15:021
2098999230,22cyclictest1635-21sh22:24:081
2098999230,22cyclictest13348-21ssh23:02:201
2098999230,22cyclictest13348-21ssh23:02:201
2098999230,22cyclictest12669-21apt-get23:31:561
2098999230,1cyclictest24894-21irqstats21:47:011
2098999230,1cyclictest15039-21diskmemload23:55:071
2098999230,0cyclictest0-21swapper/122:34:351
2098999230,0cyclictest0-21swapper/121:38:081
20987992323,0cyclictest0-21swapper/023:54:270
20987992323,0cyclictest0-21swapper/023:10:140
20987992323,0cyclictest0-21swapper/023:01:290
20987992323,0cyclictest0-21swapper/023:01:290
20987992323,0cyclictest0-21swapper/022:37:460
20987992323,0cyclictest0-21swapper/022:27:020
20987992323,0cyclictest0-21swapper/022:01:030
20987992323,0cyclictest0-21swapper/021:25:520
20987992323,0cyclictest0-21swapper/021:10:010
20987992323,0cyclictest0-21swapper/000:39:220
2098799232,0cyclictest15039-21diskmemload21:31:350
2098799230,2cyclictest1599-21cat23:21:570
2098799230,22cyclictest8118-21sh22:30:030
2098799230,22cyclictest5860-21ssh23:25:190
2098799230,22cyclictest31476-21sh23:47:150
2098799230,22cyclictest28972-21sh00:14:540
2098799230,22cyclictest2804-21ssh00:20:330
2098799230,22cyclictest15039-21diskmemload23:15:580
2098799230,22cyclictest15039-21diskmemload22:45:390
2098799230,22cyclictest15039-21diskmemload21:55:010
2098799230,22cyclictest0-21swapper/022:11:570
2098799230,0cyclictest0-21swapper/022:06:060
2098799230,0cyclictest0-21swapper/021:40:290
20997992222,0cyclictest0-21swapper/323:08:313
20997992222,0cyclictest0-21swapper/322:52:233
20997992220,1cyclictest25778-21perf19:20:013
20997992220,1cyclictest0-21swapper/320:21:573
2099799220,21cyclictest5675-21rm23:25:053
2099799220,21cyclictest26528-21sh22:46:363
2099799220,21cyclictest2086-21fschecks_time21:26:573
2099799220,21cyclictest18166-21ssh00:05:023
2099799220,21cyclictest15039-21diskmemload22:30:333
2099799220,21cyclictest15039-21diskmemload22:05:543
2099799220,21cyclictest12000-21sh21:35:533
2099799220,21cyclictest10668-21apt-get21:01:573
2099799220,21cyclictest0-21swapper/323:45:043
2099799220,21cyclictest0-21swapper/322:41:063
2099799220,21cyclictest0-21swapper/322:00:323
2099799220,1cyclictest9977-21ssh23:00:103
2099799220,1cyclictest9977-21ssh23:00:103
2099799220,1cyclictest8671-21ssh00:25:563
2099799220,1cyclictest7138-21sh22:57:073
20992992222,0cyclictest22340-21apt-get21:16:592
20992992222,0cyclictest0-21swapper/222:50:212
20992992220,2cyclictest23989-21rm00:39:102
20992992220,1cyclictest31367-21apt-get19:31:582
20992992220,1cyclictest15039-21diskmemload00:00:332
20992992220,1cyclictest0-21swapper/223:20:012
20992992220,0cyclictest0-21swapper/223:26:242
2099299220,2cyclictest30961-21perf19:30:012
2099299220,2cyclictest24219-21sh22:15:402
2099299220,21cyclictest606-21dbus-daemon20:55:012
2099299220,21cyclictest31890-21apt-get21:25:012
2099299220,21cyclictest15039-21diskmemload23:30:172
2099299220,21cyclictest13031-21runrttasks22:05:402
2099299220,21cyclictest0-21swapper/220:15:012
2099299220,21cyclictest0-21swapper/200:20:092
2099299220,1cyclictest7275-21ssh23:55:332
2099299220,0cyclictest0-21swapper/220:21:572
20989992222,0cyclictest0-21swapper/121:31:281
20989992221,1cyclictest0-21swapper/100:12:121
2098999220,21cyclictest420-21ssh21:25:281
2098999220,1cyclictest9426-21apt-get00:26:581
2098999220,1cyclictest24333-21ssh22:15:491
2098999220,1cyclictest20602-21perf20:15:011
2098999220,1cyclictest0-21swapper/121:24:011
2098999220,1cyclictest0-21swapper/120:40:001
2098999220,0cyclictest0-21swapper/123:21:351
2098999220,0cyclictest0-21swapper/122:11:011
20987992222,0cyclictest0-21swapper/000:28:210
2098799220,1cyclictest8217-21munin-run19:50:000
2098799220,1cyclictest0-21swapper/023:06:470
2098799220,1cyclictest0-21swapper/022:20:080
20997992121,0cyclictest0-21swapper/323:21:163
2099799210,20cyclictest11400-21apt-get19:56:573
2099799210,20cyclictest0-21swapper/319:36:573
2099299210,20cyclictest1336-21apt-get19:36:572
2099299210,20cyclictest0-21swapper/219:20:022
2099299210,0cyclictest0-21swapper/219:16:572
20989992121,0cyclictest0-21swapper/121:06:591
20989992121,0cyclictest0-21swapper/120:16:561
20989992119,1cyclictest10270-21munin-run21:00:011
20989992119,1cyclictest0-21swapper/120:50:011
2098999210,20cyclictest0-21swapper/121:01:571
2098999210,20cyclictest0-21swapper/119:31:581
2098999210,1cyclictest28572-21munin-run19:25:011
20987992120,1cyclictest0-21swapper/019:11:560
2098799210,0cyclictest0-21swapper/019:26:580
2098799210,0cyclictest0-21swapper/019:21:580
20997992020,0cyclictest0-21swapper/320:26:583
20997992018,1cyclictest7834-21awk20:55:013
2099299200,0cyclictest31004-21apt-get20:36:572
2099299200,0cyclictest21004-21apt-get20:16:562
20989992020,0cyclictest0-21swapper/119:46:561
20989992020,0cyclictest0-21swapper/119:26:581
20989992019,0cyclictest21362-21apt-get19:11:561
20989992017,2cyclictest5808-21awk19:45:001
2098999200,0cyclictest0-21swapper/120:51:581
2098999200,0cyclictest0-21swapper/120:41:571
20987992020,0cyclictest0-21swapper/021:06:590
2098799200,0cyclictest0-21swapper/020:36:570
20997991919,0cyclictest0-21swapper/319:46:563
20997991919,0cyclictest0-21swapper/319:11:563
20997991918,0cyclictest0-21swapper/320:36:573
20997991917,1cyclictest0-21swapper/320:15:013
20992991919,0cyclictest0-21swapper/219:41:562
20992991919,0cyclictest0-21swapper/219:11:562
20992991918,1cyclictest1001-21apt-get20:41:562
20992991918,0cyclictest26214-21apt-get20:26:582
20987991919,0cyclictest0-21swapper/021:01:570
20987991919,0cyclictest0-21swapper/019:56:570
20987991919,0cyclictest0-21swapper/019:36:560
20987991919,0cyclictest0-21swapper/019:16:570
20992991817,1cyclictest0-21swapper/219:50:022
20989991818,0cyclictest0-21swapper/120:31:571
20989991818,0cyclictest0-21swapper/120:26:581
20989991818,0cyclictest0-21swapper/120:06:571
20989991818,0cyclictest0-21swapper/119:16:571
20989991817,1cyclictest0-21swapper/119:50:021
20989991816,1cyclictest13391-21sh20:00:011
20987991818,0cyclictest0-21swapper/020:46:570
20987991817,0cyclictest21004-21apt-get20:16:560
20997991717,0cyclictest0-21swapper/319:20:023
20997991716,0cyclictest0-21swapper/319:31:583
20987991717,0cyclictest0-21swapper/020:01:570
20987991717,0cyclictest0-21swapper/019:51:570
20997991614,1cyclictest0-21swapper/320:46:583
20997991614,1cyclictest0-21swapper/320:05:013
20992991616,0cyclictest13816-21apt-get20:01:572
20992991616,0cyclictest0-21swapper/220:46:562
2099299160,15cyclictest16583-21cstates20:06:582
20989991616,0cyclictest0-21swapper/120:01:571
20987991616,0cyclictest0-21swapper/020:31:570
20987991614,1cyclictest0-21swapper/019:32:070
20997991515,0cyclictest0-21swapper/319:41:563
20997991514,0cyclictest0-21swapper/320:41:563
2099799150,15cyclictest15067-21munin-run21:10:003
20992991514,0cyclictest28609-21apt-get20:31:572
20987991515,0cyclictest0-21swapper/020:51:570
20987991513,1cyclictest5784-21cron19:45:000
20997991414,0cyclictest0-21swapper/320:55:133
20997991413,1cyclictest8193-21apt-get19:50:023
2099299144,1cyclictest8254-21apt-get20:56:582
2099299140,14cyclictest0-21swapper/219:48:032
2099299140,0cyclictest0-21swapper/221:08:092
2098999140,14cyclictest0-21swapper/119:37:041
2098799140,14cyclictest0-21swapper/020:55:010
2098799140,14cyclictest0-21swapper/020:11:180
2098799140,0cyclictest0-21swapper/020:41:570
2098799140,0cyclictest0-21swapper/020:26:590
2098799140,0cyclictest0-21swapper/020:05:100
20992991313,0cyclictest0-21swapper/219:55:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional