You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 14:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 03, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2651799263,22cyclictest12620-21latency_hist23:55:013
2650999260,25cyclictest20214-21diskmemload23:44:021
2651799250,24cyclictest27750-21rm23:10:553
2651399250,24cyclictest6102-21ssh22:51:392
2651399250,24cyclictest0-21swapper/221:31:262
2651399250,1cyclictest0-21swapper/222:24:272
2650999250,1cyclictest5921-21ssh21:25:231
2650999250,1cyclictest0-21swapper/123:59:561
2650799251,24cyclictest4355-21kworker/0:221:13:320
2650799250,24cyclictest604-21basename20:30:000
2650799250,24cyclictest20214-21diskmemload23:59:500
2650799250,24cyclictest20214-21diskmemload22:00:160
26517992423,1cyclictest17729-21diskmemload21:36:193
26517992422,1cyclictest0-21swapper/300:15:063
26517992420,3cyclictest31852-21awk21:20:003
2651799240,23cyclictest20214-21diskmemload00:37:023
2651799240,23cyclictest19039-21ssh00:30:113
2651799240,23cyclictest0-21swapper/323:07:383
2651799240,23cyclictest0-21swapper/321:25:533
26513992423,1cyclictest20214-21diskmemload21:40:402
26513992423,0cyclictest20214-21diskmemload21:58:502
26513992422,1cyclictest20214-21diskmemload00:13:382
2651399240,23cyclictest0-21swapper/223:43:442
2651399240,23cyclictest0-21swapper/222:26:152
2651399240,1cyclictest10269-21users21:28:592
2651399240,1cyclictest0-21swapper/222:18:482
2650999240,24cyclictest20214-21diskmemload22:05:101
2650999240,24cyclictest20214-21diskmemload00:17:041
2650999240,24cyclictest0-21swapper/122:27:231
2650999240,24cyclictest0-21swapper/100:10:031
2650999240,23cyclictest7631-21apt-get22:53:461
2650999240,23cyclictest20214-21diskmemload21:49:511
2650999240,23cyclictest20137-21ssh00:02:201
2650999240,0cyclictest0-21swapper/121:41:481
26507992424,0cyclictest62550irq/127-eno123:34:130
26507992422,1cyclictest21256-21ssh22:36:390
26507992421,2cyclictest26913-21ssh22:41:390
2650799240,24cyclictest0-21swapper/023:48:140
2650799240,24cyclictest0-21swapper/000:28:540
2650799240,23cyclictest20214-21diskmemload21:36:440
2650799240,23cyclictest0-21swapper/023:22:450
2650799240,23cyclictest0-21swapper/000:17:470
2650799240,1cyclictest20214-21diskmemload21:59:190
2650799240,1cyclictest0-21swapper/022:28:470
2650799240,0cyclictest20214-21diskmemload00:23:210
26517992323,0cyclictest20214-21diskmemload21:22:463
26517992323,0cyclictest0-21swapper/322:15:313
26517992323,0cyclictest0-21swapper/321:40:203
26517992323,0cyclictest0-21swapper/300:21:213
26517992323,0cyclictest0-21swapper/300:00:053
26517992322,1cyclictest0-21swapper/323:00:223
2651799230,22cyclictest783-21snmpd00:09:423
2651799230,22cyclictest20214-21diskmemload22:57:013
2651799230,22cyclictest20214-21diskmemload21:11:153
2651799230,22cyclictest0-21swapper/322:27:293
2651799230,22cyclictest0-21swapper/321:45:573
2651799230,0cyclictest0-21swapper/323:32:093
2651799230,0cyclictest0-21swapper/322:31:323
2651799230,0cyclictest0-21swapper/300:26:123
26513992322,0cyclictest0-21swapper/222:30:152
26513992321,1cyclictest30271-21ssh22:43:582
26513992321,1cyclictest13626-21ssh23:56:122
26513992321,1cyclictest0-21swapper/221:12:402
26513992321,1cyclictest0-21swapper/200:27:292
26513992320,2cyclictest29600-21ssh00:39:422
26513992320,2cyclictest27255-21ssh23:10:082
26513992320,2cyclictest23003-21ssh00:05:172
26513992319,0cyclictest0-21swapper/222:05:222
2651399230,2cyclictest24087-21ssh22:10:062
2651399230,23cyclictest1627-21ssh23:16:522
2651399230,23cyclictest0-21swapper/223:47:072
2651399230,23cyclictest0-21swapper/223:29:292
2651399230,23cyclictest0-21swapper/222:36:222
2651399230,23cyclictest0-21swapper/221:35:022
2651399230,23cyclictest0-21swapper/200:02:132
2651399230,22cyclictest25174-21ssh23:38:252
2651399230,22cyclictest20214-21diskmemload21:15:592
2651399230,22cyclictest12998-21ssh22:00:132
2651399230,22cyclictest0-21swapper/223:10:012
2651399230,22cyclictest0-21swapper/200:15:352
2651399230,1cyclictest20214-21diskmemload00:21:372
2651399230,0cyclictest0-21swapper/223:34:002
26509992323,0cyclictest20214-21diskmemload00:33:051
26509992323,0cyclictest0-21swapper/123:30:291
26509992323,0cyclictest0-21swapper/123:04:511
26509992323,0cyclictest0-21swapper/122:21:491
26509992323,0cyclictest0-21swapper/121:33:491
26509992321,1cyclictest8946-21munin-run19:40:001
26509992321,1cyclictest0-21swapper/123:45:061
2650999230,23cyclictest0-21swapper/123:39:121
2650999230,23cyclictest0-21swapper/121:53:461
2650999230,23cyclictest0-21swapper/121:19:181
2650999230,22cyclictest9549-21ssh00:23:101
2650999230,22cyclictest7201-21ssh23:21:481
2650999230,22cyclictest26641-21ssh00:38:041
2650999230,22cyclictest20214-21diskmemload00:05:281
2650999230,22cyclictest17773-21rm21:36:221
2650999230,22cyclictest1710-21apache222:16:141
2650999230,22cyclictest11033-21sh22:55:461
2650999230,22cyclictest0-21swapper/123:53:551
2650999230,0cyclictest20214-21diskmemload21:57:231
2650999230,0cyclictest20214-21diskmemload21:14:451
26507992323,0cyclictest20214-21diskmemload00:36:040
26507992323,0cyclictest20214-21diskmemload00:07:410
26507992323,0cyclictest0-21swapper/023:36:150
26507992323,0cyclictest0-21swapper/023:06:000
26507992323,0cyclictest0-21swapper/022:47:220
26507992323,0cyclictest0-21swapper/022:10:250
26507992321,1cyclictest12677-21ssh21:32:000
26507992321,1cyclictest0-21swapper/023:25:580
26507992321,1cyclictest0-21swapper/022:32:040
26507992321,1cyclictest0-21swapper/000:31:140
2650799231,21cyclictest62550irq/127-eno100:10:350
2650799230,2cyclictest3770-21rm21:52:530
2650799230,23cyclictest0-21swapper/022:09:010
2650799230,23cyclictest0-21swapper/021:19:120
2650799230,23cyclictest0-21swapper/000:00:330
2650799230,22cyclictest31798-21ssh23:14:010
2650799230,22cyclictest28203-21sendmail-msp20:20:000
2650799230,21cyclictest9196-21ssh23:52:500
2650799230,1cyclictest0-21swapper/021:45:400
2650799230,0cyclictest0-21swapper/023:17:090
2650799230,0cyclictest0-21swapper/022:57:030
26517992222,0cyclictest0-21swapper/323:56:273
26517992222,0cyclictest0-21swapper/323:45:363
26517992222,0cyclictest0-21swapper/323:37:003
26517992222,0cyclictest0-21swapper/322:22:163
26517992222,0cyclictest0-21swapper/321:55:243
26517992221,0cyclictest0-21swapper/321:30:483
26517992220,1cyclictest0-21swapper/322:50:393
26517992220,1cyclictest0-21swapper/322:42:153
2651799220,22cyclictest0-21swapper/319:23:453
2651799220,21cyclictest607-21in:imuxsock20:05:013
2651799220,21cyclictest20214-21diskmemload22:10:043
2651799220,21cyclictest1254-21ssh23:16:113
2651799220,21cyclictest0-21swapper/323:40:013
2651799220,21cyclictest0-21swapper/323:25:033
2651799220,21cyclictest0-21swapper/322:38:503
2651799220,21cyclictest0-21swapper/322:05:423
2651799220,21cyclictest0-21swapper/322:00:203
2651799220,21cyclictest0-21swapper/319:35:003
2651799220,21cyclictest0-21swapper/319:13:463
2651799220,1cyclictest8918-21cron19:40:003
2651799220,1cyclictest0-21swapper/323:22:473
2651799220,1cyclictest0-21swapper/300:10:283
2651799220,0cyclictest0-21swapper/321:51:023
26513992222,0cyclictest0-21swapper/223:51:272
26513992221,0cyclictest20214-21diskmemload21:20:202
26513992221,0cyclictest0-21swapper/222:55:392
26513992220,1cyclictest5992-21apt-get20:43:462
26513992220,1cyclictest20214-21diskmemload23:01:192
2651399220,21cyclictest20214-21diskmemload21:50:262
2651399220,21cyclictest19270-21ssh00:30:382
2651399220,21cyclictest13177-21apt-get20:58:482
2651399220,21cyclictest0-21swapper/222:45:142
2651399220,21cyclictest0-21swapper/219:25:022
26509992222,0cyclictest0-21swapper/122:31:101
26509992221,1cyclictest4547-21sh21:23:551
26509992221,1cyclictest11519-21rm23:25:021
26509992221,1cyclictest0-21swapper/122:00:111
26509992220,1cyclictest31781-21sh22:45:371
2650999220,22cyclictest0-21swapper/120:18:451
2650999220,21cyclictest8387-21apt-get20:48:471
2650999220,21cyclictest5549-21sh23:19:461
2650999220,21cyclictest20214-21diskmemload00:25:021
2650999220,21cyclictest0-21swapper/123:10:321
2650999220,1cyclictest21479-21apt-get20:08:461
2650999220,1cyclictest0-21swapper/122:15:011
26507992222,0cyclictest0-21swapper/023:41:130
26507992221,1cyclictest0-21swapper/022:16:290
26507992221,1cyclictest0-21swapper/021:23:460
26507992221,1cyclictest0-21swapper/020:33:470
2650799220,22cyclictest20214-21diskmemload21:26:200
2650799220,22cyclictest0-21swapper/023:03:470
2650799220,21cyclictest5484-21ssh22:50:440
2650799220,21cyclictest31894-21apt-get19:23:450
2650799220,21cyclictest3017-21ssh22:20:120
2650799220,1cyclictest0-21swapper/019:30:000
26517992120,1cyclictest0-21swapper/320:23:443
26517992119,1cyclictest31332-21idleruntime-cro19:20:013
2651799210,20cyclictest0-21swapper/322:45:013
2651799210,20cyclictest0-21swapper/320:43:453
26513992121,0cyclictest0-21swapper/219:58:472
26513992120,0cyclictest0-21swapper/220:38:472
26513992119,1cyclictest17448-21apt-get21:05:022
2651399210,20cyclictest29425-21apt-get19:18:462
2651399210,1cyclictest5909-21ssh23:20:012
26509992121,0cyclictest9478-21apt-get19:43:431
26509992121,0cyclictest3575-21apt-get20:38:471
26509992121,0cyclictest0-21swapper/122:37:311
26509992121,0cyclictest0-21swapper/120:13:451
2650999210,21cyclictest22009-21ssh23:05:401
2650999210,0cyclictest0-21swapper/120:53:461
26507992120,0cyclictest4674-21apt-get19:33:460
2650799210,20cyclictest0-21swapper/019:53:450
2650799210,0cyclictest0-21swapper/021:03:460
26517992020,0cyclictest0-21swapper/319:28:463
26517992018,1cyclictest0-21swapper/320:40:013
2651799200,0cyclictest0-21swapper/321:03:463
2651799200,0cyclictest0-21swapper/319:58:473
26513992020,0cyclictest0-21swapper/220:28:462
2651399200,19cyclictest0-21swapper/220:13:462
26509992019,1cyclictest28742-21apt-get20:23:441
26509992018,1cyclictest28876-21sh19:15:011
2650999200,0cyclictest0-21swapper/119:50:001
2650999200,0cyclictest0-21swapper/119:28:461
26507992020,0cyclictest0-21swapper/020:38:470
26507992020,0cyclictest0-21swapper/020:08:460
26513991916,2cyclictest17441-21turbostat.cron21:05:002
26509991919,0cyclictest19085-21apt-get20:03:471
26509991919,0cyclictest0-21swapper/119:18:461
26509991917,1cyclictest0-21swapper/120:45:011
26507991919,0cyclictest0-21swapper/021:08:460
26507991919,0cyclictest0-21swapper/019:13:460
26507991918,0cyclictest0-21swapper/020:48:470
26507991917,1cyclictest20937-21perf20:05:010
2650799190,0cyclictest16667-21apt-get19:58:470
26517991818,0cyclictest0-21swapper/320:53:463
26517991818,0cyclictest0-21swapper/319:55:013
26517991817,0cyclictest0-21swapper/320:08:463
26513991818,0cyclictest0-21swapper/220:08:462
26513991818,0cyclictest0-21swapper/219:48:462
26513991818,0cyclictest0-21swapper/219:13:462
26513991816,1cyclictest10781-21apt-get20:53:462
26509991818,0cyclictest0-21swapper/120:58:481
26509991818,0cyclictest0-21swapper/119:33:461
26507991816,1cyclictest15021-21awk21:00:000
26513991717,0cyclictest31894-21apt-get19:23:452
2650999170,0cyclictest0-21swapper/120:33:471
26507991717,0cyclictest0-21swapper/020:53:460
26517991616,0cyclictest0-21swapper/319:48:463
2651799160,15cyclictest0-21swapper/320:58:533
2651799160,15cyclictest0-21swapper/320:13:473
26513991613,2cyclictest30660-21perf20:25:002
2651399160,15cyclictest27652-21systemctl20:18:532
26509991616,0cyclictest15592-21apt-get21:03:461
26509991616,0cyclictest0-21swapper/121:05:021
26509991614,1cyclictest16156-21cat19:55:011
26507991616,0cyclictest23874-21apt-get20:13:460
2651799150,14cyclictest0-21swapper/320:18:473
26513991515,0cyclictest1169-21apt-get20:33:472
26513991515,0cyclictest0-21swapper/220:48:472
26513991515,0cyclictest0-21swapper/220:03:472
26513991514,0cyclictest0-21swapper/219:38:442
2651399150,1cyclictest0-21swapper/219:43:462
26509991514,1cyclictest17663-21grep19:58:521
26507991515,0cyclictest0-21swapper/019:43:430
26507991515,0cyclictest0-21swapper/019:18:460
26507991514,1cyclictest0-21swapper/020:43:460
2651799140,14cyclictest0-21swapper/320:33:183
2651799140,14cyclictest0-21swapper/320:25:303
2651799140,14cyclictest0-21swapper/319:43:223
2651799140,0cyclictest0-21swapper/321:05:193
2651799140,0cyclictest0-21swapper/320:46:483
26513991414,0cyclictest0-21swapper/219:30:512
2651399140,14cyclictest0-21swapper/219:50:312
26507991414,0cyclictest0-21swapper/019:45:110
26507991414,0cyclictest0-21swapper/019:36:510
2650799140,14cyclictest0-21swapper/020:20:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional