You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 03:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 06, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15002992624,1cyclictest23838-21sh22:51:203
1500299250,24cyclictest8193-21diskmemload00:01:023
1500299250,24cyclictest0-21swapper/323:43:463
1499999250,24cyclictest0-21swapper/222:22:372
1499999250,1cyclictest3608-21ssh00:28:282
14994992525,0cyclictest8193-21diskmemload23:32:030
1499499250,24cyclictest8193-21diskmemload00:13:180
1499499250,24cyclictest8193-21diskmemload00:07:180
1499499250,24cyclictest0-21swapper/021:12:220
1499499250,1cyclictest17349-21idleruntime-cro19:15:010
1500299240,23cyclictest8193-21diskmemload21:19:473
1500299240,23cyclictest0-21swapper/321:59:093
1500299240,1cyclictest0-21swapper/323:26:163
1500299240,1cyclictest0-21swapper/323:20:433
14999992421,2cyclictest9341-21phc2sys-jitter23:06:332
14999992421,2cyclictest2202-21ssh22:01:362
1499999240,24cyclictest28586-21ssh23:24:112
14996992424,0cyclictest0-21swapper/122:33:021
1499699240,24cyclictest8193-21diskmemload00:07:331
1499699240,24cyclictest0-21swapper/121:59:481
1499699240,1cyclictest0-21swapper/121:41:411
14994992423,1cyclictest62550irq/127-eno122:34:570
14994992423,1cyclictest0-21swapper/022:54:570
14994992423,1cyclictest0-21swapper/021:29:510
14994992422,1cyclictest26238-21sendmail-msp20:40:000
1499499242,1cyclictest62550irq/127-eno100:22:200
14994992421,2cyclictest23872-21ssh21:23:300
1499499240,23cyclictest0-21swapper/023:16:570
1499499240,23cyclictest0-21swapper/000:38:040
1499499240,23cyclictest0-21swapper/000:26:400
1499499240,0cyclictest0-21swapper/023:58:530
15002992323,0cyclictest0-21swapper/323:11:363
15002992323,0cyclictest0-21swapper/322:25:263
15002992323,0cyclictest0-21swapper/321:20:243
15002992321,1cyclictest0-21swapper/322:17:323
15002992320,2cyclictest29354-21grep19:40:003
1500299230,2cyclictest8443-21ssh22:07:023
1500299230,23cyclictest0-21swapper/321:54:383
1500299230,23cyclictest0-21swapper/321:40:293
1500299230,23cyclictest0-21swapper/300:20:053
1500299230,22cyclictest21522-21sh23:17:083
1500299230,22cyclictest17316-21munin-run22:45:003
1500299230,22cyclictest12826-21sh00:07:093
1500299230,22cyclictest0-21swapper/323:30:393
1500299230,1cyclictest0-21swapper/321:11:163
1500299230,1cyclictest0-21swapper/300:19:323
1500299230,0cyclictest8193-21diskmemload22:55:573
1500299230,0cyclictest8193-21diskmemload21:46:563
1500299230,0cyclictest0-21swapper/323:55:193
1500299230,0cyclictest0-21swapper/323:36:403
1500299230,0cyclictest0-21swapper/323:07:503
1500299230,0cyclictest0-21swapper/322:33:103
1500299230,0cyclictest0-21swapper/321:25:203
1500299230,0cyclictest0-21swapper/300:32:143
14999992323,0cyclictest0-21swapper/221:46:242
14999992323,0cyclictest0-21swapper/221:25:472
14999992323,0cyclictest0-21swapper/200:14:352
14999992318,0cyclictest0-21swapper/221:44:042
1499999230,2cyclictest29635-21ssh23:25:222
1499999230,2cyclictest11225-21ssh00:36:082
1499999230,23cyclictest8193-21diskmemload22:30:302
1499999230,23cyclictest0-21swapper/223:04:042
1499999230,23cyclictest0-21swapper/223:04:042
1499999230,23cyclictest0-21swapper/221:55:492
1499999230,23cyclictest0-21swapper/221:53:542
1499999230,23cyclictest0-21swapper/221:10:462
1499999230,22cyclictest8202-21idleruntime-cro21:10:002
1499999230,22cyclictest20215-21ssh23:46:122
1499999230,22cyclictest19775-21idleruntime-cro19:20:012
1499999230,22cyclictest16453-21ssh23:12:412
1499999230,22cyclictest0-21swapper/219:15:012
1499999230,0cyclictest8193-21diskmemload23:17:142
1499999230,0cyclictest0-21swapper/223:44:592
1499999230,0cyclictest0-21swapper/223:36:142
1499999230,0cyclictest0-21swapper/221:36:332
14996992323,0cyclictest8193-21diskmemload22:38:031
14996992323,0cyclictest0-21swapper/123:10:061
14996992323,0cyclictest0-21swapper/121:54:151
14996992323,0cyclictest0-21swapper/100:03:261
14996992322,1cyclictest8193-21diskmemload21:48:241
14996992321,1cyclictest5923-21apt-get00:31:271
14996992321,1cyclictest0-21swapper/100:13:121
14996992320,2cyclictest30669-21sh23:55:201
14996992320,2cyclictest30389-21sh21:29:171
14996992320,2cyclictest30318-21ssh22:56:311
14996992320,2cyclictest0-21swapper/119:25:011
14996992320,1cyclictest313-21systemd-journal23:30:001
1499699230,2cyclictest7788-21ssh21:37:221
1499699230,2cyclictest3439-21idleruntime-cro21:00:011
1499699230,23cyclictest8193-21diskmemload21:18:591
1499699230,23cyclictest8193-21diskmemload21:11:311
1499699230,23cyclictest0-21swapper/123:52:091
1499699230,23cyclictest0-21swapper/122:42:091
1499699230,23cyclictest0-21swapper/122:07:391
1499699230,23cyclictest0-21swapper/122:03:141
1499699230,23cyclictest0-21swapper/121:24:231
1499699230,22cyclictest29824-21sh00:22:341
1499699230,22cyclictest26958-21ssh22:53:121
1499699230,22cyclictest18564-21ssh23:15:251
1499699230,22cyclictest13980-21ssh23:40:011
1499699230,0cyclictest0-21swapper/123:49:051
1499699230,0cyclictest0-21swapper/123:07:511
1499699230,0cyclictest0-21swapper/100:17:111
14994992323,0cyclictest8193-21diskmemload22:16:250
14994992321,1cyclictest8193-21diskmemload22:25:330
14994992321,1cyclictest10876-21ssh21:41:190
14994992321,1cyclictest0-21swapper/022:58:120
14994992320,2cyclictest31774-21dump-pmu-power19:45:000
14994992320,2cyclictest11979-21sh23:09:130
1499499230,2cyclictest3411-21sleep21:00:010
1499499230,23cyclictest0-21swapper/021:45:170
1499499230,23cyclictest0-21swapper/021:31:480
1499499230,22cyclictest8193-21diskmemload23:48:410
1499499230,0cyclictest8193-21diskmemload23:10:220
1499499230,0cyclictest8193-21diskmemload22:43:340
1499499230,0cyclictest8193-21diskmemload21:19:120
1499499230,0cyclictest0-21swapper/022:37:300
1499499230,0cyclictest0-21swapper/022:20:390
1499499230,0cyclictest0-21swapper/021:57:020
1499499230,0cyclictest0-21swapper/021:51:220
15002992222,0cyclictest0-21swapper/323:00:393
15002992222,0cyclictest0-21swapper/323:00:393
15002992222,0cyclictest0-21swapper/300:25:083
15002992221,1cyclictest0-21swapper/322:11:423
15002992220,1cyclictest11531-21ssh00:36:283
1500299220,22cyclictest0-21swapper/322:01:053
1500299220,21cyclictest26361-21df_inode23:51:293
1500299220,21cyclictest0-21swapper/321:35:013
1500299220,21cyclictest0-21swapper/321:30:473
1500299220,21cyclictest0-21swapper/320:26:273
1500299220,21cyclictest0-21swapper/319:26:263
1500299220,1cyclictest28645-21munin-run20:45:013
1500299220,1cyclictest24517-21sh23:49:523
1500299220,1cyclictest23829-21munin-run20:35:003
1500299220,1cyclictest0-21swapper/322:22:033
14999992222,0cyclictest8193-21diskmemload22:56:242
14999992222,0cyclictest0-21swapper/223:30:162
14999992222,0cyclictest0-21swapper/222:35:082
14999992222,0cyclictest0-21swapper/200:15:302
14999992220,2cyclictest12323-21ssh22:40:382
14999992220,1cyclictest21787-21apt-get20:31:272
14999992220,1cyclictest17427-21ssh21:17:162
14999992220,1cyclictest0-21swapper/223:55:032
14999992220,1cyclictest0-21swapper/222:45:552
14999992219,2cyclictest31745-21cron19:45:002
1499999221,1cyclictest20283-21ssh21:20:502
1499999220,21cyclictest30018-21ssh00:22:482
1499999220,21cyclictest29359-21sh22:26:322
1499999220,21cyclictest23133-21ssh22:50:162
1499999220,21cyclictest0-21swapper/223:51:022
1499999220,21cyclictest0-21swapper/222:05:312
1499999220,21cyclictest0-21swapper/221:30:222
1499999220,1cyclictest8193-21diskmemload22:10:232
1499999220,1cyclictest7803-21ssh00:31:392
1499999220,0cyclictest19893-21kworker/u8:100:05:422
14996992222,0cyclictest0-21swapper/123:21:241
14996992222,0cyclictest0-21swapper/123:00:121
14996992222,0cyclictest0-21swapper/123:00:121
14996992222,0cyclictest0-21swapper/100:36:281
14996992221,1cyclictest8193-21diskmemload22:12:551
14996992221,1cyclictest0-21swapper/120:30:001
14996992220,1cyclictest31099-21rm21:30:041
14996992220,1cyclictest0-21swapper/123:31:271
14996992220,1cyclictest0-21swapper/119:40:001
1499699220,21cyclictest8193-21diskmemload22:45:131
1499699220,21cyclictest2162-21apt19:50:001
1499699220,1cyclictest32444-21diskmemload00:25:511
1499699220,0cyclictest0-21swapper/123:35:401
1499699220,0cyclictest0-21swapper/122:21:251
14994992222,0cyclictest0-21swapper/023:50:530
14994992222,0cyclictest0-21swapper/023:29:020
14994992222,0cyclictest0-21swapper/021:35:350
14994992221,1cyclictest8193-21diskmemload22:01:350
14994992220,2cyclictest0-21swapper/000:15:160
14994992220,1cyclictest11564-21sh22:10:550
14994992220,1cyclictest0-21swapper/021:01:280
1499499220,22cyclictest0-21swapper/023:37:100
1499499220,22cyclictest0-21swapper/000:30:280
1499499220,21cyclictest0-21swapper/022:45:130
1499499220,1cyclictest28211-21ssh23:23:440
1499499220,1cyclictest0-21swapper/023:40:250
1499499220,1cyclictest0-21swapper/022:05:160
15002992121,0cyclictest0-21swapper/322:35:023
15002992121,0cyclictest0-21swapper/321:06:283
15002992120,0cyclictest0-21swapper/319:21:273
1500299210,21cyclictest0-21swapper/322:45:083
1500299210,20cyclictest0-21swapper/320:16:263
1500299210,1cyclictest14203-21latency_hist20:15:013
1500299210,0cyclictest0-21swapper/321:01:283
1500299210,0cyclictest0-21swapper/320:06:273
1500299210,0cyclictest0-21swapper/319:31:273
14999992120,1cyclictest12179-21apt-get20:11:282
14999992119,1cyclictest0-21swapper/220:20:002
1499999210,21cyclictest0-21swapper/220:21:282
1499999210,21cyclictest0-21swapper/219:46:252
1499999210,20cyclictest7337-21apt-get20:01:272
1499999210,20cyclictest31390-21apt-get20:51:292
1499999210,20cyclictest2522-21apt-get19:51:272
1499999210,0cyclictest8193-21diskmemload00:00:072
1499999210,0cyclictest0-21swapper/220:26:282
14996992121,0cyclictest0-21swapper/119:51:271
14996992120,1cyclictest14571-21apt-get20:16:261
14994992120,1cyclictest0-21swapper/020:41:270
1499499210,20cyclictest0-21swapper/020:31:270
1499499210,20cyclictest0-21swapper/019:21:270
1499499210,1cyclictest19764-21perf19:20:010
1499499210,0cyclictest0-21swapper/020:51:280
1499499210,0cyclictest0-21swapper/019:31:270
15002992019,0cyclictest17001-21apt-get20:21:293
15002992019,0cyclictest0-21swapper/319:16:263
1500299200,19cyclictest0-21swapper/319:51:273
1500299200,0cyclictest0-21swapper/320:36:283
14999992020,0cyclictest0-21swapper/219:31:272
14999992018,1cyclictest26202-21turbostat.cron20:40:002
1499699200,0cyclictest0-21swapper/119:41:291
14994992020,0cyclictest0-21swapper/019:36:280
1499499200,0cyclictest0-21swapper/019:56:270
15002991919,0cyclictest0-21swapper/319:56:273
14999991919,0cyclictest0-21swapper/220:46:272
14999991918,0cyclictest26598-21apt-get20:41:272
14996991919,0cyclictest22535-21apt-get19:26:261
14996991918,0cyclictest0-21swapper/120:21:281
14994991919,0cyclictest0-21swapper/020:11:280
14994991918,0cyclictest0-21swapper/019:45:020
15002991818,0cyclictest0-21swapper/319:46:253
15002991817,1cyclictest0-21swapper/320:01:273
15002991817,0cyclictest0-21swapper/320:51:293
14996991818,0cyclictest0-21swapper/121:06:271
14996991818,0cyclictest0-21swapper/120:06:261
14996991816,1cyclictest26973-21munin-run19:35:001
14996991816,1cyclictest0-21swapper/120:40:001
14994991818,0cyclictest2522-21apt-get19:51:270
14994991818,0cyclictest0-21swapper/020:16:260
14999991717,0cyclictest0-21swapper/220:56:262
14996991717,0cyclictest0-21swapper/120:41:261
14994991717,0cyclictest9729-21apt-get20:06:260
14994991717,0cyclictest0-21swapper/020:26:270
15002991616,0cyclictest1361-21apt-get20:56:263
15002991614,1cyclictest31778-21perf19:45:003
14996991616,0cyclictest0-21swapper/120:11:281
1499499160,15cyclictest31036-21munin-run20:50:010
1499499160,0cyclictest0-21swapper/019:26:260
14999991513,1cyclictest11574-21sshd20:07:212
1499999150,6cyclictest0-21swapper/219:56:272
1499999150,14cyclictest0-21swapper/221:01:312
15002991414,0cyclictest0-21swapper/320:46:273
1500299140,14cyclictest0-21swapper/319:10:503
14999991414,0cyclictest0-21swapper/219:35:442
1499999140,14cyclictest0-21swapper/219:28:532
1499999140,14cyclictest0-21swapper/219:22:242
14996991414,0cyclictest0-21swapper/121:00:171
1499699140,14cyclictest0-21swapper/120:50:051
1499699140,0cyclictest0-21swapper/120:30:371
1499699140,0cyclictest0-21swapper/120:00:101
1499699140,0cyclictest0-21swapper/119:15:261
1499499140,0cyclictest0-21swapper/020:21:400
1499499140,0cyclictest0-21swapper/020:00:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional