You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 16:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jun 04, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
803299270,26cyclictest19974-21cron07:35:001
804099250,24cyclictest0-21swapper/310:27:383
8032992523,2cyclictest27186-21ssh11:03:581
8032992523,1cyclictest0-21swapper/109:18:251
8032992522,2cyclictest6196-21perf12:15:011
803299250,1cyclictest0-21swapper/111:20:251
803099250,24cyclictest0-21swapper/009:22:270
803099250,24cyclictest0-21swapper/007:38:520
8040992424,0cyclictest0-21swapper/312:08:583
8040992423,1cyclictest1726-21diskmemload11:40:483
804099240,23cyclictest6720-21ssh09:14:323
804099240,23cyclictest24403-21ssh10:00:393
804099240,23cyclictest1726-21diskmemload10:10:243
804099240,23cyclictest0-21swapper/311:31:583
804099240,1cyclictest0-21swapper/312:24:593
803699242,21cyclictest1726-21diskmemload11:33:502
8036992422,1cyclictest0-21swapper/210:31:302
8036992420,0cyclictest0-21swapper/210:25:342
803699240,23cyclictest30335-21ssh09:36:252
8032992421,2cyclictest10872-21ssh10:18:521
803299240,24cyclictest0-21swapper/112:36:271
803299240,23cyclictest4579-21ssh10:43:421
803299240,23cyclictest1726-21diskmemload10:11:021
803299240,23cyclictest0-21swapper/112:06:161
803099242,22cyclictest62550irq/127-eno111:18:270
803099240,2cyclictest29634-21ssh10:35:370
803099240,24cyclictest1726-21diskmemload11:47:310
803099240,24cyclictest0-21swapper/011:31:280
803099240,23cyclictest0-21swapper/009:50:420
803099240,0cyclictest1726-21diskmemload12:15:170
8040992323,0cyclictest0-21swapper/312:19:013
8040992323,0cyclictest0-21swapper/311:00:173
8040992323,0cyclictest0-21swapper/309:59:163
8040992323,0cyclictest0-21swapper/309:39:163
8040992320,2cyclictest18688-21sh09:25:373
8040992320,2cyclictest12792-21ssh10:50:083
804099230,23cyclictest0-21swapper/312:11:563
804099230,23cyclictest0-21swapper/310:37:443
804099230,22cyclictest9139-21sh09:47:193
804099230,22cyclictest8461-21ssh11:47:263
804099230,22cyclictest22496-21turbostat07:40:003
804099230,22cyclictest1726-21diskmemload12:35:223
804099230,22cyclictest16517-21missed_timers09:23:563
804099230,22cyclictest12391-21ssh11:20:123
804099230,0cyclictest1726-21diskmemload09:42:493
804099230,0cyclictest0-21swapper/311:35:283
804099230,0cyclictest0-21swapper/310:33:443
804099230,0cyclictest0-21swapper/308:53:503
8036992323,0cyclictest1726-21diskmemload11:53:042
8036992323,0cyclictest0-21swapper/212:15:582
8036992323,0cyclictest0-21swapper/211:11:082
8036992323,0cyclictest0-21swapper/211:11:082
8036992323,0cyclictest0-21swapper/210:56:232
8036992323,0cyclictest0-21swapper/210:10:132
8036992323,0cyclictest0-21swapper/209:49:332
8036992323,0cyclictest0-21swapper/209:31:122
8036992323,0cyclictest0-21swapper/209:16:292
8036992323,0cyclictest0-21swapper/209:11:202
8036992321,1cyclictest30005-21ssh10:06:062
8036992320,2cyclictest28841-21ssh11:05:162
803699230,2cyclictest607-21in:imuxsock08:50:012
803699230,2cyclictest17628-21rm09:54:262
803699230,2cyclictest14008-21ssh09:21:292
803699230,23cyclictest0-21swapper/212:38:432
803699230,23cyclictest0-21swapper/212:31:192
803699230,23cyclictest0-21swapper/212:25:512
803699230,23cyclictest0-21swapper/211:42:512
803699230,23cyclictest0-21swapper/210:39:162
803699230,22cyclictest2435-21sh12:12:042
803699230,22cyclictest24114-21ssh10:00:082
803699230,22cyclictest23057-21ssh12:00:182
803699230,22cyclictest1726-21diskmemload11:55:192
803699230,22cyclictest11999-21cron11:20:012
803699230,22cyclictest0-21swapper/211:49:162
803699230,22cyclictest0-21swapper/211:02:582
803699230,0cyclictest0-21swapper/211:36:542
803699230,0cyclictest0-21swapper/210:45:002
8032992323,0cyclictest1726-21diskmemload11:47:471
8032992323,0cyclictest0-21swapper/111:43:281
8032992323,0cyclictest0-21swapper/111:28:391
8032992323,0cyclictest0-21swapper/111:08:351
8032992323,0cyclictest0-21swapper/110:27:521
8032992322,1cyclictest1726-21diskmemload12:20:421
8032992321,1cyclictest8425-21sh10:46:301
8032992321,1cyclictest19259-21diskmemload10:56:501
8032992321,1cyclictest0-21swapper/111:35:311
8032992321,1cyclictest0-21swapper/109:29:371
8032992320,2cyclictest1914-21dump-pmu-power10:40:011
803299230,23cyclictest0-21swapper/111:58:521
803299230,23cyclictest0-21swapper/109:59:381
803299230,22cyclictest7961-21rm12:17:191
803299230,22cyclictest31340-21ssh09:37:581
803299230,22cyclictest13569-21diskmemload09:20:521
803299230,22cyclictest13389-21ssh10:20:211
803299230,22cyclictest0-21swapper/111:17:471
803299230,1cyclictest0-21swapper/111:11:361
803299230,1cyclictest0-21swapper/111:11:361
803299230,0cyclictest0-21swapper/110:53:171
803299230,0cyclictest0-21swapper/109:54:111
803299230,0cyclictest0-21swapper/109:33:061
8030992323,0cyclictest1726-21diskmemload10:46:010
8030992323,0cyclictest0-21swapper/011:25:110
8030992323,0cyclictest0-21swapper/011:21:540
8030992323,0cyclictest0-21swapper/011:05:240
8030992323,0cyclictest0-21swapper/009:47:350
8030992322,1cyclictest18251-21ssh11:56:130
8030992322,1cyclictest1726-21diskmemload10:05:570
8030992322,1cyclictest0-21swapper/012:14:590
8030992322,1cyclictest0-21swapper/010:40:190
8030992321,1cyclictest6630-21cron11:15:010
8030992321,1cyclictest6630-21cron11:15:010
8030992321,1cyclictest29213-21ssh11:36:310
8030992321,1cyclictest24879-21ssh09:31:560
8030992321,1cyclictest12713-21apt-get08:28:500
8030992320,2cyclictest29734-21rm09:35:350
803099230,2cyclictest28345-21ssh12:05:130
803099230,22cyclictest7931-21ssh10:15:010
803099230,22cyclictest2887-21ssh09:40:570
803099230,22cyclictest23946-21ssh10:30:160
803099230,22cyclictest1726-21diskmemload12:35:590
803099230,22cyclictest1726-21diskmemload11:03:140
803099230,22cyclictest1726-21diskmemload09:27:130
803099230,22cyclictest12269-21sh11:50:070
803099230,22cyclictest0-21swapper/009:10:160
803099230,0cyclictest1726-21diskmemload10:26:320
803099230,0cyclictest0-21swapper/010:57:400
803099230,0cyclictest0-21swapper/010:20:510
803099230,0cyclictest0-21swapper/009:18:300
8040992222,0cyclictest0-21swapper/311:55:153
8040992222,0cyclictest0-21swapper/311:52:573
8040992222,0cyclictest0-21swapper/310:45:003
8040992222,0cyclictest0-21swapper/309:33:093
8040992221,1cyclictest22846-21ssh12:30:483
8040992221,1cyclictest1726-21diskmemload10:41:123
8040992221,1cyclictest0-21swapper/311:13:413
8040992221,1cyclictest0-21swapper/311:13:413
804099220,22cyclictest0-21swapper/312:25:213
804099220,22cyclictest0-21swapper/311:25:313
804099220,22cyclictest0-21swapper/310:20:193
804099220,21cyclictest9030-21sh11:18:153
804099220,21cyclictest27112-21apt-get08:58:503
804099220,21cyclictest1726-21diskmemload10:05:163
804099220,21cyclictest15761-21apt-get07:28:513
804099220,21cyclictest0-21swapper/310:55:333
804099220,21cyclictest0-21swapper/307:53:513
804099220,1cyclictest0-21swapper/312:00:273
804099220,0cyclictest0-21swapper/309:16:583
8036992222,0cyclictest0-21swapper/210:42:302
8036992222,0cyclictest0-21swapper/210:21:392
8036992222,0cyclictest0-21swapper/210:15:132
8036992220,1cyclictest12926-21rm10:50:192
8036992220,1cyclictest0-21swapper/212:20:102
803699220,21cyclictest1726-21diskmemload12:05:542
803699220,21cyclictest1726-21diskmemload09:41:312
803699220,21cyclictest15115-21apt-get08:33:522
803699220,21cyclictest0-21swapper/211:26:042
803699220,21cyclictest0-21swapper/207:33:492
803699220,1cyclictest7347-21latency_hist08:15:012
803699220,1cyclictest13042-21ssh11:21:152
803699220,1cyclictest0-21swapper/209:57:302
8032992220,1cyclictest9776-21munin-run08:20:011
8032992220,1cyclictest4430-21apt-get09:13:501
803299220,21cyclictest606-21dbus-daemon07:30:011
803299220,21cyclictest31386-21cat09:05:011
803299220,21cyclictest19927-21apt-get08:43:501
803299220,21cyclictest12450-21ssh11:50:221
803299220,21cyclictest0-21swapper/112:30:191
803299220,21cyclictest0-21swapper/110:00:031
803299220,21cyclictest0-21swapper/109:45:181
803299220,1cyclictest32520-21perf08:00:011
803299220,1cyclictest14551-21dump-pmu-power08:30:001
803299220,1cyclictest0-21swapper/111:34:391
803299220,0cyclictest0-21swapper/110:06:191
8030992222,0cyclictest1726-21diskmemload12:01:060
8030992222,0cyclictest0-21swapper/012:22:350
8030992220,2cyclictest24981-21ssh12:33:540
8030992220,1cyclictest10946-21apt-get07:18:500
8030992220,1cyclictest0-21swapper/011:41:110
8030992220,1cyclictest0-21swapper/010:10:030
8030992220,1cyclictest0-21swapper/008:50:010
803099220,22cyclictest19511-21ssh09:56:210
803099220,21cyclictest17268-21ssh12:25:200
803099220,1cyclictest12805-21diskmemload10:50:080
8040992120,1cyclictest0-21swapper/307:35:003
8040992120,0cyclictest0-21swapper/307:40:023
804099210,21cyclictest0-21swapper/311:05:133
804099210,1cyclictest4910-21sleep08:10:013
804099210,0cyclictest0-21swapper/308:33:523
8036992119,1cyclictest18407-21ssh09:25:122
803699210,21cyclictest0-21swapper/207:48:502
803699210,20cyclictest20658-21apt-get07:38:522
803699210,20cyclictest17617-21munin-run07:30:012
803699210,1cyclictest23139-21apt-get07:40:022
803699210,1cyclictest0-21swapper/208:58:502
8032992121,0cyclictest0-21swapper/112:25:101
8032992121,0cyclictest0-21swapper/108:38:501
8032992121,0cyclictest0-21swapper/108:33:521
8032992119,1cyclictest0-21swapper/112:00:041
803299210,20cyclictest0-21swapper/108:08:511
803299210,1cyclictest0-21swapper/108:58:501
8030992121,0cyclictest0-21swapper/008:03:510
8030992121,0cyclictest0-21swapper/008:03:510
8030992119,1cyclictest0-21swapper/008:08:510
8030992118,2cyclictest32515-21cat08:00:010
803099210,21cyclictest0-21swapper/008:53:500
803099210,20cyclictest17510-21apt-get08:38:500
803099210,20cyclictest0-21swapper/008:18:520
803099210,20cyclictest0-21swapper/007:40:020
803099210,0cyclictest0-21swapper/010:00:230
8040992020,0cyclictest0-21swapper/308:18:513
8040992020,0cyclictest0-21swapper/307:48:503
8036992020,0cyclictest0-21swapper/207:13:512
803699200,19cyclictest629-21apt-get08:03:512
803699200,19cyclictest629-21apt-get08:03:512
803699200,0cyclictest0-21swapper/207:23:512
8032992020,0cyclictest0-21swapper/109:05:021
803299200,20cyclictest0-21swapper/107:43:511
8030992020,0cyclictest0-21swapper/008:43:500
8030992018,1cyclictest31993-21apt-get09:05:020
8030992018,1cyclictest28259-21apt-get07:53:510
803099200,0cyclictest8552-21apt-get07:13:510
8040991919,0cyclictest5501-21apt-get08:13:503
8040991919,0cyclictest0-21swapper/307:23:513
804099190,0cyclictest0-21swapper/307:13:513
8036991919,0cyclictest0-21swapper/208:43:502
8032991919,0cyclictest0-21swapper/108:53:501
8032991919,0cyclictest0-21swapper/107:18:501
8032991919,0cyclictest0-21swapper/107:13:511
8030991917,1cyclictest17598-21wc07:30:010
8030991916,2cyclictest27703-21grep07:50:000
8040991818,0cyclictest0-21swapper/308:38:503
8040991818,0cyclictest0-21swapper/308:03:513
8040991818,0cyclictest0-21swapper/308:03:513
8036991818,0cyclictest0-21swapper/208:53:502
8036991816,1cyclictest32507-21tr08:00:012
8036991716,0cyclictest0-21swapper/209:08:512
8036991715,1cyclictest29529-21apt-get09:03:502
8032991716,1cyclictest27681-21cron07:50:001
8030991717,0cyclictest0-21swapper/008:13:500
8030991716,0cyclictest29529-21apt-get09:03:500
8040991616,0cyclictest0-21swapper/308:43:503
804099160,15cyclictest0-21swapper/308:30:003
8036991616,0cyclictest3051-21apt-get08:08:512
8036991616,0cyclictest12163-21perf08:25:002
8036991616,0cyclictest0-21swapper/208:18:522
803299160,15cyclictest22492-21apt-get07:40:001
803099166,9cyclictest15115-21apt-get08:33:520
8040991512,3cyclictest0-21swapper/307:55:193
804099150,14cyclictest11850-21memory07:18:543
8036991515,0cyclictest0-21swapper/208:28:502
8036991513,1cyclictest30116-21munin-run07:55:002
8032991514,1cyclictest0-21swapper/108:15:011
8032991513,1cyclictest30115-21dump-pmu-power07:55:001
8030991512,2cyclictest15206-21latency_hist07:25:010
8040991411,2cyclictest31368-21apt-get09:05:023
804099140,14cyclictest0-21swapper/309:00:303
804099140,14cyclictest0-21swapper/308:20:093
804099140,0cyclictest0-21swapper/308:45:453
8036991414,0cyclictest0-21swapper/208:35:592
803699140,14cyclictest0-21swapper/207:15:292
8032991414,0cyclictest0-21swapper/107:20:331
803299140,14cyclictest0-21swapper/108:21:101
803299140,0cyclictest0-21swapper/108:45:131
803299140,0cyclictest0-21swapper/108:00:501
803299140,0cyclictest0-21swapper/108:00:501
8030991414,0cyclictest0-21swapper/008:21:160
8030991414,0cyclictest0-21swapper/007:30:280
803099140,14cyclictest0-21swapper/008:55:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional