You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 11:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Tue Sep 01, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3073029177,10sleep00-21swapper/019:05:340
3078628164,13sleep10-21swapper/119:06:201
3075728169,8sleep20-21swapper/219:05:552
2934228062,16sleep30-21swapper/319:05:163
58122730,0sleep00-21swapper/000:32:070
156852700,0sleep20-21swapper/222:21:492
3116399290,1cyclictest0-21swapper/323:54:233
3116399280,1cyclictest0-21swapper/300:05:153
3116399260,1cyclictest0-21swapper/323:14:473
3115499260,25cyclictest0-21swapper/100:05:161
3116399250,23cyclictest0-21swapper/321:27:463
3116399250,23cyclictest0-21swapper/321:27:463
3116399250,21cyclictest0-21swapper/322:08:153
3116399250,0cyclictest0-21swapper/323:58:243
3115499250,0cyclictest0-21swapper/123:54:231
3116399242,3cyclictest17527-21latency_hist21:45:003
3116399240,1cyclictest0-21swapper/323:40:023
3116399240,18cyclictest0-21swapper/322:35:143
3115499240,20cyclictest0-21swapper/122:43:461
3116399230,2cyclictest0-21swapper/322:23:413
3116399230,2cyclictest0-21swapper/322:12:043
3116399221,2cyclictest0-21swapper/322:59:203
3115899220,22cyclictest0-21swapper/222:54:022
31154992220,2cyclictest0-21swapper/121:41:551
3115499220,3cyclictest0-21swapper/123:14:481
3115499220,2cyclictest0-21swapper/100:28:111
3116399210,3cyclictest0-21swapper/322:43:463
3116399210,1cyclictest0-21swapper/300:36:043
3116399210,19cyclictest0-21swapper/321:16:593
3115499210,1cyclictest0-21swapper/123:58:251
3115499210,18cyclictest0-21swapper/122:08:151
3115499210,0cyclictest0-21swapper/121:27:471
3115499210,0cyclictest0-21swapper/121:27:461
3114999210,21cyclictest0-21swapper/000:11:320
3116399200,4cyclictest0-21swapper/300:10:523
3116399200,2cyclictest0-21swapper/300:17:443
3116399200,0cyclictest0-21swapper/323:00:493
3115499200,19cyclictest0-21swapper/123:06:311
3116399190,0cyclictest0-21swapper/323:06:313
3115499190,2cyclictest0-21swapper/123:15:581
3115499190,2cyclictest0-21swapper/123:15:581
3114999197,6cyclictest4655-21munin-run20:30:000
3116399181,1cyclictest0-21swapper/321:50:493
3116399180,0cyclictest0-21swapper/322:30:513
31158991810,7cyclictest32-21ksoftirqd/200:07:042
3115499181,1cyclictest0-21swapper/100:00:061
3115499180,3cyclictest0-21swapper/122:12:031
3115499180,1cyclictest23739-21diskmemload22:02:341
3115499180,1cyclictest0-21swapper/122:48:361
31149991817,1cyclictest0-21swapper/023:02:420
3116399178,1cyclictest141rcu_preempt22:26:203
31163991715,1cyclictest0-21swapper/323:27:003
3116399171,14cyclictest0-21swapper/300:26:443
3116399170,6cyclictest0-21swapper/323:15:193
3116399170,6cyclictest0-21swapper/323:15:183
3116399170,1cyclictest0-21swapper/322:16:033
3116399170,16cyclictest0-21swapper/323:32:443
3115899170,17cyclictest0-21swapper/223:03:452
3115499171,15cyclictest6339-21ssh21:37:551
3115499170,4cyclictest0-21swapper/100:24:241
3115499170,1cyclictest0-21swapper/123:32:231
3115499170,16cyclictest0-21swapper/120:50:131
3114999170,3cyclictest0-21swapper/022:12:380
3116399160,1cyclictest0-21swapper/300:22:173
3115899160,1cyclictest0-21swapper/221:13:532
3115899160,14cyclictest0-21swapper/200:15:052
3115499163,2cyclictest31144-21cyclictest00:33:001
31154991612,2cyclictest0-21swapper/122:33:551
31154991611,4cyclictest591-21cron21:35:001
3115499160,1cyclictest0-21swapper/100:13:031
3115499160,16cyclictest0-21swapper/123:26:591
31163991513,1cyclictest18676-21irqstats00:00:183
3115899151,0cyclictest0-21swapper/223:05:132
3115899150,1cyclictest141rcu_preempt21:39:532
3115899150,13cyclictest0-21swapper/221:45:022
3115499154,3cyclictest0-21swapper/119:20:131
3115499151,14cyclictest23739-21diskmemload21:22:201
3115499150,2cyclictest0-21swapper/121:16:581
3115499150,2cyclictest0-21swapper/100:35:481
3115499150,1cyclictest0-21swapper/123:36:041
3115499150,0cyclictest0-21swapper/123:00:501
3116399141,9cyclictest0-21swapper/321:45:123
3116399141,3cyclictest0-21swapper/321:32:293
3115899143,6cyclictest0-21swapper/200:14:342
3115899140,2cyclictest0-21swapper/221:27:492
3115899140,2cyclictest0-21swapper/221:27:492
3115899140,1cyclictest0-21swapper/222:02:072
3115499149,4cyclictest28087-21tr20:10:161
3115499142,11cyclictest23739-21diskmemload23:47:191
3115499141,13cyclictest23739-21diskmemload23:40:191
3115499140,0cyclictest0-21swapper/121:50:501
3114999147,6cyclictest30291-21apt-get23:10:000
3114999147,6cyclictest28458-21systemd00:06:550
3114999146,7cyclictest11847-21munin-run20:45:000
31149991412,1cyclictest0-21swapper/022:25:140
3116399132,9cyclictest23739-21diskmemload23:49:203
31163991310,2cyclictest8998-21sh21:40:013
3116399130,10cyclictest23739-21diskmemload21:55:473
3115899138,4cyclictest11292-21grep00:35:202
3115899132,8cyclictest32-21ksoftirqd/220:45:142
31158991311,2cyclictest17323-21cron21:45:002
31158991311,1cyclictest32-21ksoftirqd/223:10:082
31158991310,2cyclictest3134-21cut21:55:182
31158991310,2cyclictest22930-21wc20:00:002
31158991310,2cyclictest20313-21taskset22:25:132
31158991310,2cyclictest1676-21wc20:20:272
31158991310,2cyclictest13691-21sort22:40:152
3115899130,13cyclictest0-21swapper/223:55:402
31154991311,1cyclictest30222-21sh21:13:331
31154991310,2cyclictest22801-21basename20:00:001
3115499130,1cyclictest0-21swapper/122:51:451
3114999139,3cyclictest18954-21cron21:00:010
3114999139,3cyclictest17160-21ssh23:40:160
3114999136,6cyclictest3494-21perf19:20:010
31149991310,2cyclictest30466-21sort22:30:260
31149991310,2cyclictest23797-21grep20:00:190
31149991310,2cyclictest18134-21grep21:45:140
31149991310,2cyclictest10905-21tr22:00:120
3116399129,2cyclictest9045-21sed20:35:263
3116399129,2cyclictest31506-21wc20:15:223
3116399129,2cyclictest26644-21grep20:05:223
3116399129,2cyclictest23084-21grep20:00:143
3116399129,2cyclictest15206-21ssh23:20:083
3116399129,2cyclictest11895-21sed19:35:193
3116399129,2cyclictest10000-21tr20:40:163
3116399124,7cyclictest15801-21aten2_r7power_p19:45:143
3116399123,2cyclictest6185-21apt-get19:25:143
31163991210,1cyclictest2734-21sh00:30:193
3116399120,2cyclictest0-21swapper/323:39:323
3116399120,11cyclictest31020-21ntp_states22:50:203
3115899129,2cyclictest8860-21tr21:20:142
3115899129,2cyclictest7769-21head23:15:172
3115899129,2cyclictest7769-21head23:15:172
3115899129,2cyclictest4609-21ssh22:35:142
3115899129,2cyclictest3541-21chrt23:50:572
3115899129,2cyclictest30621-21grep22:30:272
3115899129,2cyclictest26979-21cron22:09:592
3115899129,2cyclictest25027-21chrt23:25:212
3115899129,2cyclictest23757-21grep20:00:182
3115899129,2cyclictest22172-21grep22:45:172
3115899129,2cyclictest21853-21tr21:05:152
3115899129,2cyclictest18209-21cut00:20:172
3115899128,3cyclictest25492-21dpkg00:04:592
3115899128,3cyclictest17774-21head23:40:222
3115899122,6cyclictest225-21systemd-journal20:30:002
3115899122,10cyclictest0-21swapper/222:55:252
3115899120,0cyclictest0-21swapper/223:30:192
3115499129,2cyclictest9969-21wc19:30:241
3115499129,2cyclictest7237-21cat19:25:221
3115499129,2cyclictest4125-21ssh22:15:161
3115499129,2cyclictest25729-21apt21:50:001
3115499129,2cyclictest25045-21taskset20:03:391
3115499129,2cyclictest13934-21ssh22:20:271
3115499129,2cyclictest1379-21ls20:20:221
3115499129,2cyclictest10912-21sed00:15:251
3115499126,2cyclictest11037-21uname20:40:231
31154991211,1cyclictest0-21swapper/122:37:311
3115499120,12cyclictest0-21swapper/122:27:431
3115499120,11cyclictest8397-21chrt21:58:321
3114999129,2cyclictest9992-21grep23:55:180
3114999129,2cyclictest9305-21grep19:30:160
3114999129,2cyclictest7574-21grep20:35:150
3114999129,2cyclictest31667-21cat20:15:260
3114999129,2cyclictest28163-21cat21:50:260
3114999129,2cyclictest16175-21grep20:50:260
3114999129,2cyclictest13274-21grep22:40:140
3114999129,2cyclictest13204-21wc19:40:010
3114999129,2cyclictest12755-21grep20:45:180
3114999129,2cyclictest12051-21tr22:20:140
3114999128,2cyclictest26120-21cat23:45:190
3114999122,6cyclictest0-21swapper/021:13:530
31149991211,1cyclictest0-21swapper/022:54:020
31149991210,1cyclictest18261-21ssh00:20:170
3114999120,12cyclictest0-21swapper/021:42:320
3114999120,11cyclictest749-21grep20:20:170
3114999120,11cyclictest0-21swapper/023:31:170
3116399119,1cyclictest297772sleep320:13:243
3116399119,1cyclictest25969-21ssh21:10:243
3116399119,1cyclictest24692-21taskset22:46:293
3116399119,1cyclictest211492sleep321:02:283
3116399119,1cyclictest15420-21cron19:45:003
3116399119,1cyclictest12659-21tail22:00:253
3116399118,2cyclictest351-21tr20:20:163
3116399118,2cyclictest22236-21cut21:05:163
3116399118,2cyclictest15146-21cut20:50:163
3116399118,2cyclictest10210-21grep19:30:323
3116399113,4cyclictest0-21swapper/320:45:143
3116399113,3cyclictest0-21swapper/319:20:133
3116399111,5cyclictest0-21swapper/321:20:133
3116399111,2cyclictest225-21systemd-journal20:56:153
3116399110,10cyclictest4091-21sed20:25:253
3116399110,10cyclictest0-21swapper/319:50:033
3115899119,1cyclictest26190-21sed20:05:172
3115899118,2cyclictest9982-21tr20:40:152
3115899118,2cyclictest8042-21tr20:35:162
3115899118,2cyclictest3391-21sh22:15:102
3115899118,2cyclictest32644-21ssh22:12:532
3115899118,2cyclictest32443-21sh21:15:082
3115899118,2cyclictest31643-21grep19:10:152
3115899118,2cyclictest30372-21rm00:27:292
3115899118,2cyclictest28764-21wc20:10:202
3115899118,2cyclictest2797-21sort00:30:202
3115899118,2cyclictest25780-21ssh21:30:162
3115899118,2cyclictest25194-21tr23:45:142
3115899118,2cyclictest2292-21cut19:15:192
3115899118,2cyclictest21269-21chrt21:04:002
3115899118,2cyclictest18957-21sort19:50:162
3115899118,2cyclictest18074-21tr20:55:212
3115899118,2cyclictest16601-21grep23:20:192
3115899118,2cyclictest14719-21tr20:50:142
3115899118,2cyclictest13548-21grep19:40:152
3115899110,6cyclictest0-21swapper/223:36:372
3115899110,1cyclictest0-21swapper/221:54:462
3115499119,1cyclictest8118-21head20:35:171
3115499119,1cyclictest31844-21expr19:10:151
3115499119,1cyclictest25685-21grep20:05:141
3115499119,1cyclictest21580-21seq21:05:031
3115499119,1cyclictest19513-21head19:50:221
3115499119,1cyclictest17574-21head20:55:181
3115499119,1cyclictest15705-21cut19:45:141
3115499119,1cyclictest15171-21ssh23:20:061
3115499119,1cyclictest14015-21taskset20:47:341
3115499119,1cyclictest10941-21cut19:35:151
3115499118,2cyclictest6621-21ssh22:55:171
3115499118,2cyclictest19582-21ls21:00:151
3115499117,3cyclictest31889-21head20:15:261
3115499110,10cyclictest25372sleep120:25:121
3114999119,1cyclictest21430-21grep19:55:170
3114999119,1cyclictest21166-21sh22:05:280
3114999119,1cyclictest18487-21grep00:00:160
3114999119,1cyclictest17611-21cut21:25:180
3114999119,1cyclictest17611-21cut21:25:170
3114999119,1cyclictest13-21ksoftirqd/023:12:270
3114999118,2cyclictest8858-21grep21:20:140
3114999118,2cyclictest7070-21cut23:15:140
3114999118,2cyclictest7070-21cut23:15:140
3114999118,2cyclictest5669-21grep20:30:160
3114999118,2cyclictest3851-21cut19:20:130
3114999118,2cyclictest32041-21sort19:10:170
3114999118,2cyclictest3000-21grep21:35:240
3114999118,2cyclictest23234-21ssh22:45:260
3114999118,2cyclictest1647-21tr23:50:160
3114999118,2cyclictest15952-21tr19:45:140
3114999118,2cyclictest11959-21ssh22:39:340
3114999118,2cyclictest10901-21cut00:35:180
3114999114,2cyclictest0-21swapper/021:55:140
3114999112,1cyclictest0-21swapper/021:30:490
3114999110,10cyclictest20033-21cut21:00:180
3116399109,1cyclictest20728-21grep19:55:153
3116399108,1cyclictest31946-21sed19:10:163
3116399108,1cyclictest2077-21tail19:15:173
3116399107,2cyclictest5166-21tr20:30:143
3115899108,1cyclictest56152sleep219:22:022
3115899108,1cyclictest48652sleep220:30:022
3115899108,1cyclictest320112sleep220:16:312
3115899107,2cyclictest6463-21tr19:25:152
3115899107,2cyclictest16415-21tail19:45:182
3115899106,3cyclictest11666-21head19:35:172
3115899100,9cyclictest10587-21chrt19:34:122
3115499108,2cyclictest2146-21sh19:15:181
3115499108,1cyclictest4869-21chrt20:30:051
3115499108,1cyclictest14991-21grep19:40:271
3114999108,2cyclictest11400-21ssh23:36:300
3114999108,2cyclictest11279-21rm00:15:390
3114999108,1cyclictest23530-21ssh23:25:070
3114999107,2cyclictest8487-21ssh22:17:450
3114999107,2cyclictest3020-21ssh21:16:060
3114999107,2cyclictest28340-21sed20:10:170
3114999107,2cyclictest27526-21cron20:09:590
3114999107,2cyclictest18260-21basename19:50:110
3114999100,9cyclictest5397-21sh22:55:010
3114999100,9cyclictest18588-21ssh23:21:260
3114999100,9cyclictest13369-21cut19:40:140
311499997,2cyclictest27829-21rm00:25:320
311499997,1cyclictest6952-21tail19:25:200
311499997,1cyclictest21600-21cat21:05:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional