You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 22:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat May 23, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31799992621,4cyclictest0-21swapper/209:35:592
3179999260,25cyclictest11321-21rm11:48:072
3179699260,25cyclictest0-21swapper/110:17:031
31793992621,4cyclictest10727-21awk08:40:010
3179999250,24cyclictest25545-21diskmemload12:12:482
3179999250,24cyclictest25545-21diskmemload10:47:482
3179999250,24cyclictest0-21swapper/212:35:172
3179999250,1cyclictest0-21swapper/212:26:042
3179999250,1cyclictest0-21swapper/210:04:092
31796992523,1cyclictest25904-21ls08:05:001
3179699250,24cyclictest25545-21diskmemload10:11:381
31793992523,1cyclictest32744-21ssh10:42:480
31793992523,1cyclictest0-21swapper/010:21:130
3179399250,0cyclictest0-21swapper/011:45:560
31806992423,1cyclictest25545-21diskmemload12:26:313
31806992423,1cyclictest25545-21diskmemload09:46:243
31806992422,1cyclictest6809-21ssh11:16:173
3180699240,23cyclictest6849-21cpuspeed_turbos09:22:543
3180699240,23cyclictest11869-21cron09:55:003
3180699240,23cyclictest0-21swapper/310:40:053
3180699240,23cyclictest0-21swapper/310:22:343
31799992423,1cyclictest25545-21diskmemload12:02:132
31799992421,2cyclictest0-21swapper/209:52:052
31799992420,0cyclictest0-21swapper/209:59:122
3179999240,23cyclictest27585-21ssh12:32:182
3179999240,23cyclictest0-21swapper/211:34:162
3179999240,23cyclictest0-21swapper/211:01:352
3179999240,0cyclictest25545-21diskmemload12:16:592
31796992424,0cyclictest27779-21ssh11:06:101
31796992423,0cyclictest0-21swapper/110:54:211
3179699240,2cyclictest8283-21ssh11:46:211
3179699240,2cyclictest21994-21sh10:03:161
3179699240,24cyclictest0-21swapper/109:44:221
3179699240,23cyclictest25545-21diskmemload11:58:561
3179699240,23cyclictest19384-21ssh12:24:141
3179699240,1cyclictest28799-21ssh12:03:441
3179699240,1cyclictest27248-21ssh11:33:431
3179699240,0cyclictest0-21swapper/112:17:531
3179399243,20cyclictest62550irq/127-eno109:32:210
3179399240,24cyclictest25545-21diskmemload11:43:100
3179399240,23cyclictest31178-21munin-run09:15:010
3179399240,23cyclictest25545-21diskmemload12:01:110
3179399240,23cyclictest10612-21ssh09:53:140
3179399240,23cyclictest0-21swapper/012:28:060
3179399240,23cyclictest0-21swapper/009:23:410
3179399240,0cyclictest25545-21diskmemload10:11:350
3179399240,0cyclictest0-21swapper/012:20:170
31806992323,0cyclictest25545-21diskmemload09:35:523
31806992323,0cyclictest0-21swapper/311:23:113
31806992323,0cyclictest0-21swapper/311:00:543
31806992323,0cyclictest0-21swapper/310:25:143
31806992323,0cyclictest0-21swapper/310:05:113
31806992323,0cyclictest0-21swapper/309:30:073
31806992323,0cyclictest0-21swapper/309:26:443
31806992323,0cyclictest0-21swapper/309:18:173
31806992323,0cyclictest0-21swapper/308:37:523
31806992321,1cyclictest8301-21sh12:14:363
31806992321,1cyclictest34-21ksoftirqd/312:30:103
31806992321,1cyclictest25922-21munin-run08:05:003
31806992321,1cyclictest0-21swapper/311:56:173
31806992321,1cyclictest0-21swapper/311:50:573
31806992321,1cyclictest0-21swapper/311:28:433
31806992321,1cyclictest0-21swapper/311:07:533
3180699230,23cyclictest0-21swapper/311:36:063
3180699230,23cyclictest0-21swapper/311:36:063
3180699230,22cyclictest661-21ntp_states12:07:563
3180699230,22cyclictest0-21swapper/312:21:163
3180699230,22cyclictest0-21swapper/312:16:253
3180699230,22cyclictest0-21swapper/310:51:323
3180699230,0cyclictest25545-21diskmemload11:40:563
3180699230,0cyclictest25545-21diskmemload11:30:123
3180699230,0cyclictest0-21swapper/311:45:533
3180699230,0cyclictest0-21swapper/310:47:213
3180699230,0cyclictest0-21swapper/310:39:283
3180699230,0cyclictest0-21swapper/310:01:003
3180699230,0cyclictest0-21swapper/309:42:463
31799992323,0cyclictest0-21swapper/212:20:132
31799992323,0cyclictest0-21swapper/209:16:132
31799992322,1cyclictest12333-21ssh10:23:362
31799992322,1cyclictest0-21swapper/210:15:322
31799992322,0cyclictest0-21swapper/210:11:452
31799992321,1cyclictest0-21swapper/211:41:452
3179999230,2cyclictest15668-21ssh09:29:462
3179999230,23cyclictest0-21swapper/210:35:222
3179999230,23cyclictest0-21swapper/209:33:212
3179999230,22cyclictest30361-21ssh12:05:322
3179999230,22cyclictest29453-21ssh11:36:302
3179999230,22cyclictest29453-21ssh11:36:302
3179999230,22cyclictest25545-21diskmemload10:41:522
3179999230,22cyclictest2331-21diskmemload09:46:542
3179999230,22cyclictest1649-21cron08:15:002
3179999230,22cyclictest0-21swapper/211:21:582
3179999230,22cyclictest0-21swapper/211:15:532
3179999230,1cyclictest29031-21apt-get11:07:522
3179999230,1cyclictest25545-21diskmemload11:55:192
3179999230,1cyclictest25545-21diskmemload11:25:432
3179999230,0cyclictest0-21swapper/211:53:172
3179999230,0cyclictest0-21swapper/210:28:212
3179999230,0cyclictest0-21swapper/209:21:452
31796992323,0cyclictest0-21swapper/110:41:371
31796992323,0cyclictest0-21swapper/110:06:081
31796992323,0cyclictest0-21swapper/109:34:331
31796992321,1cyclictest0-21swapper/109:27:561
31796992320,2cyclictest8252-21ssh10:20:171
31796992320,2cyclictest805-21ssh11:10:481
31796992320,2cyclictest32698-21ssh12:36:011
31796992320,2cyclictest31493-21ssh09:15:071
3179699231,1cyclictest7846-21ssh09:51:491
3179699230,23cyclictest0-21swapper/111:53:221
3179699230,23cyclictest0-21swapper/111:27:361
3179699230,23cyclictest0-21swapper/110:49:421
3179699230,23cyclictest0-21swapper/109:57:451
3179699230,22cyclictest8287-21sh08:35:011
3179699230,22cyclictest313-21systemd-journal08:20:011
3179699230,22cyclictest26385-21ssh12:30:401
3179699230,22cyclictest16784-21apt-get07:47:521
3179699230,1cyclictest30215-21ssh11:37:261
3179699230,1cyclictest30215-21ssh11:37:261
3179699230,0cyclictest25545-21diskmemload12:28:251
3179699230,0cyclictest0-21swapper/109:45:551
31793992323,0cyclictest0-21swapper/010:15:070
31793992323,0cyclictest0-21swapper/009:15:040
31793992321,2cyclictest0-21swapper/012:35:220
31793992320,2cyclictest6417-21sh11:15:480
3179399230,23cyclictest0-21swapper/010:06:530
3179399230,22cyclictest28620-21ssh09:41:150
3179399230,22cyclictest22236-21ssh09:35:090
3179399230,22cyclictest17933-21sh08:55:000
3179399230,22cyclictest16565-21ssh10:56:160
3179399230,22cyclictest12917-21rm11:21:590
3179399230,22cyclictest1278-21sh11:11:340
3179399230,22cyclictest11754-21ssh10:52:340
3179399230,22cyclictest0-21swapper/012:10:120
3179399230,21cyclictest0-21swapper/011:50:130
3179399230,0cyclictest0-21swapper/012:07:020
3179399230,0cyclictest0-21swapper/011:32:410
3179399230,0cyclictest0-21swapper/009:25:030
31806992222,0cyclictest0-21swapper/312:01:343
31806992222,0cyclictest0-21swapper/311:13:403
3180699220,22cyclictest0-21swapper/309:11:433
3180699220,21cyclictest0-21swapper/312:35:023
3180699220,21cyclictest0-21swapper/307:42:523
3180699220,1cyclictest8940-21perf07:30:013
3180699220,1cyclictest18697-21turbostat07:50:013
3180699220,1cyclictest0-21swapper/310:12:003
31799992222,0cyclictest0-21swapper/210:31:112
31799992222,0cyclictest0-21swapper/209:11:172
31799992221,1cyclictest21575-21apt-get07:57:522
31799992220,1cyclictest6521-21cron07:25:002
31799992220,1cyclictest0-21swapper/208:25:012
31799992220,1cyclictest0-21swapper/208:25:012
3179999220,2cyclictest10322-21ssh10:50:362
3179999220,22cyclictest0-21swapper/210:58:152
3179999220,22cyclictest0-21swapper/209:42:112
3179999220,21cyclictest23887-21ssh10:05:342
3179999220,21cyclictest13909-21perf07:40:012
31796992222,0cyclictest0-21swapper/112:14:311
31796992222,0cyclictest0-21swapper/109:11:501
31796992220,1cyclictest5911-21munin-run08:30:011
31796992220,1cyclictest26529-21apt-get08:05:021
3179699220,22cyclictest0-21swapper/110:27:231
3179699220,21cyclictest25545-21diskmemload11:00:551
3179699220,21cyclictest19744-21ssh10:30:281
3179699220,1cyclictest6237-21sh11:15:341
3179699220,1cyclictest3765-21/usr/sbin/munin11:42:521
3179699220,1cyclictest25545-21diskmemload12:06:541
3179699220,1cyclictest11616-21ssh11:20:131
3179699220,1cyclictest0-21swapper/110:36:331
3179699220,0cyclictest25545-21diskmemload10:56:271
31793992222,0cyclictest0-21swapper/011:56:400
31793992221,1cyclictest0-21swapper/011:05:400
31793992221,0cyclictest0-21swapper/012:32:090
31793992220,1cyclictest12389-21ssh09:55:200
3179399220,22cyclictest13383-21ssh12:18:380
3179399220,22cyclictest0-21swapper/011:25:590
3179399220,22cyclictest0-21swapper/007:33:060
3179399220,21cyclictest25893-21apt-get08:05:020
3179399220,21cyclictest22702-21sh11:01:520
3179399220,21cyclictest21575-21apt-get07:57:530
3179399220,21cyclictest0-21swapper/010:02:440
3179399220,21cyclictest0-21swapper/009:47:020
3179399220,21cyclictest0-21swapper/008:42:510
3179399220,1cyclictest4373-21ssh10:45:410
3179399220,1cyclictest28581-21sh11:35:140
3179399220,1cyclictest28581-21sh11:35:140
3179399220,1cyclictest25404-21ssh10:35:330
3179399220,1cyclictest20842-21apt-get09:02:510
3179399220,1cyclictest14718-21ssh10:26:220
3179399220,1cyclictest0-21swapper/010:31:080
31806992119,1cyclictest17935-21idleruntime-cro08:55:003
3180699210,21cyclictest0-21swapper/310:15:153
3180699210,20cyclictest0-21swapper/307:22:523
3180699210,1cyclictest1104-21awk08:20:013
3180699210,1cyclictest0-21swapper/307:20:003
3180699210,0cyclictest0-21swapper/308:22:523
3180699210,0cyclictest0-21swapper/308:22:523
31799992120,0cyclictest14391-21apt-get07:42:522
3179999210,20cyclictest0-21swapper/208:05:022
3179999210,1cyclictest6383-21apt-get08:32:532
31796992121,0cyclictest23381-21apt-get09:05:021
31796992119,1cyclictest10674-21sendmail08:40:011
3179699210,21cyclictest0-21swapper/109:20:181
31793992120,1cyclictest23991-21apt-get08:02:530
31793992119,1cyclictest6555-21grep07:25:000
31806992020,0cyclictest0-21swapper/309:02:513
31806992020,0cyclictest0-21swapper/308:47:523
31806992017,2cyclictest23491-21dump-pmu-power08:00:003
3180699200,0cyclictest0-21swapper/308:42:523
31799992020,0cyclictest0-21swapper/208:47:522
31799992019,1cyclictest0-21swapper/208:37:522
31799992019,0cyclictest0-21swapper/209:02:512
31796992020,0cyclictest0-21swapper/108:57:511
31796992020,0cyclictest0-21swapper/107:57:521
31793992020,0cyclictest0-21swapper/007:27:510
31806991917,1cyclictest20376-21perf09:00:003
31806991917,1cyclictest0-21swapper/309:10:013
3179999190,0cyclictest0-21swapper/207:17:522
31796991919,0cyclictest0-21swapper/107:42:521
31793991919,0cyclictest0-21swapper/008:47:520
31793991919,0cyclictest0-21swapper/008:17:500
31799991818,0cyclictest31573-21apt-get08:17:502
31796991818,0cyclictest0-21swapper/108:12:521
31796991818,0cyclictest0-21swapper/107:27:511
31796991818,0cyclictest0-21swapper/107:12:511
31796991817,0cyclictest0-21swapper/107:52:521
31806991717,0cyclictest0-21swapper/307:52:523
31806991715,1cyclictest8309-21munin-run08:35:013
31806991715,1cyclictest29176-21apt-get08:12:523
31799991717,0cyclictest0-21swapper/207:47:522
31799991716,1cyclictest11191-21apt-get08:42:522
31799991716,0cyclictest3982-21apt-get08:27:522
31796991717,0cyclictest1579-21apt-get08:22:521
31796991717,0cyclictest1579-21apt-get08:22:521
31793991717,0cyclictest0-21swapper/007:37:530
31793991716,0cyclictest0-21swapper/007:12:510
31806991616,0cyclictest0-21swapper/308:07:533
31806991614,1cyclictest13897-21sendmail-msp07:40:013
31799991616,0cyclictest0-21swapper/207:33:062
31799991614,1cyclictest22759-21apt-get09:05:022
31799991614,1cyclictest20223-21ntp_states07:52:582
31793991616,0cyclictest19179-21apt-get07:52:520
31793991616,0cyclictest0-21swapper/008:22:520
31793991616,0cyclictest0-21swapper/008:22:520
3179399160,16cyclictest0-21swapper/007:17:320
3179399160,15cyclictest0-21swapper/009:00:000
3179399160,15cyclictest0-21swapper/008:28:010
31799991515,0cyclictest0-21swapper/207:12:522
31799991514,1cyclictest0-21swapper/207:27:442
31799991513,1cyclictest20333-21cron09:00:002
31796991515,0cyclictest6561-21perf07:25:001
31796991515,0cyclictest2214-21apt-get07:17:521
31796991514,1cyclictest0-21swapper/109:05:011
3180699140,14cyclictest0-21swapper/307:30:123
3180699140,14cyclictest0-21swapper/307:11:423
3180699140,0cyclictest0-21swapper/308:25:313
31799991414,0cyclictest0-21swapper/208:00:362
3179999140,14cyclictest0-21swapper/208:50:162
31796991414,0cyclictest0-21swapper/107:30:071
3179699140,14cyclictest0-21swapper/108:51:021
3179699140,14cyclictest0-21swapper/108:46:441
3179699140,14cyclictest0-21swapper/108:40:021
31793991414,0cyclictest0-21swapper/009:05:020
31793991414,0cyclictest0-21swapper/007:40:140
3179399140,14cyclictest0-21swapper/008:31:350
3179399140,0cyclictest0-21swapper/008:10:030
3179399140,0cyclictest0-21swapper/007:45:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional