You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 01:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon May 18, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1368299260,25cyclictest15010-21ssh09:44:010
1369299250,24cyclictest7848-21diskmemload11:22:023
1369299250,24cyclictest0-21swapper/310:43:333
1369199250,1cyclictest16005-21ssh11:39:142
1368699250,1cyclictest0-21swapper/111:49:041
1368699250,0cyclictest0-21swapper/110:23:271
13682992522,2cyclictest9179-21sh10:07:340
1368299250,24cyclictest7848-21diskmemload09:37:320
1369299240,23cyclictest7848-21diskmemload10:26:373
1369299240,23cyclictest5292-21rm09:35:483
1369299240,23cyclictest0-21swapper/309:19:573
1369299240,1cyclictest7848-21diskmemload11:54:003
13691992420,3cyclictest0-21swapper/209:56:472
1369199240,23cyclictest21988-21ssh10:18:192
1369199240,23cyclictest18283-21ssh10:43:272
1369199240,23cyclictest14276-21ssh12:07:092
1369199240,23cyclictest0-21swapper/209:42:492
1369199240,1cyclictest7848-21diskmemload09:46:252
1369199240,1cyclictest30313-21ssh11:22:352
1369199240,1cyclictest10752-21apt-get12:32:292
1368699240,24cyclictest7848-21diskmemload09:35:121
1368699240,24cyclictest11594-21ssh09:12:341
1368699240,24cyclictest0-21swapper/110:51:421
1368699240,23cyclictest7848-21diskmemload12:22:291
1368699240,23cyclictest28606-21ssh11:22:251
1368699240,23cyclictest23017-21/usr/sbin/munin09:22:321
1368699240,23cyclictest0-21swapper/110:58:221
1368699240,1cyclictest0-21swapper/111:18:191
1368699240,1cyclictest0-21swapper/109:15:251
1368699240,0cyclictest7848-21diskmemload09:45:231
13682992423,1cyclictest62550irq/127-eno112:33:080
13682992423,1cyclictest0-21swapper/011:40:190
1368299240,2cyclictest9551-21ssh11:05:010
1368299240,2cyclictest9551-21ssh11:05:010
1368299240,24cyclictest0-21swapper/012:37:200
1368299240,23cyclictest7848-21diskmemload11:25:310
1368299240,23cyclictest0-21swapper/011:20:110
1368299240,23cyclictest0-21swapper/010:41:340
1368299240,22cyclictest24511-21sh09:23:330
1368299240,1cyclictest17764-21ssh12:09:320
1368299240,0cyclictest0-21swapper/011:58:380
13692992323,0cyclictest7848-21diskmemload12:01:253
13692992323,0cyclictest0-21swapper/312:19:193
13692992323,0cyclictest0-21swapper/312:05:083
13692992323,0cyclictest0-21swapper/311:31:033
13692992323,0cyclictest0-21swapper/310:24:453
13692992323,0cyclictest0-21swapper/309:45:573
13692992322,1cyclictest20183-21sh11:14:083
13692992321,1cyclictest0-21swapper/312:37:303
13692992320,2cyclictest26780-21sh09:26:223
13692992320,2cyclictest15681-21ssh10:12:593
13692992320,2cyclictest13847-21sh09:14:593
13692992320,2cyclictest11469-21rm11:07:243
13692992320,0cyclictest151rcu_preempt10:53:043
1369299230,2cyclictest23226-21cat11:17:273
1369299230,23cyclictest7848-21diskmemload10:05:383
1369299230,23cyclictest0-21swapper/312:20:133
1369299230,23cyclictest0-21swapper/311:59:453
1369299230,23cyclictest0-21swapper/311:46:003
1369299230,23cyclictest0-21swapper/309:57:083
1369299230,22cyclictest7848-21diskmemload10:57:113
1369299230,22cyclictest16519-21ssh11:39:533
1369299230,22cyclictest0-21swapper/310:30:423
1369299230,1cyclictest3938-21ssh11:27:573
1369299230,0cyclictest0-21swapper/312:30:223
1369299230,0cyclictest0-21swapper/312:28:243
1369299230,0cyclictest0-21swapper/309:41:183
13691992323,0cyclictest0-21swapper/212:23:322
13691992323,0cyclictest0-21swapper/211:52:422
13691992323,0cyclictest0-21swapper/211:46:162
13691992323,0cyclictest0-21swapper/211:40:052
13691992323,0cyclictest0-21swapper/210:20:252
13691992323,0cyclictest0-21swapper/210:07:472
13691992322,1cyclictest0-21swapper/210:50:162
13691992321,1cyclictest0-21swapper/209:20:432
1369199230,2cyclictest4982-21ssh11:01:082
1369199230,2cyclictest4982-21ssh11:01:082
1369199230,2cyclictest18791-21rm12:10:402
1369199230,23cyclictest0-21swapper/210:45:202
1369199230,23cyclictest0-21swapper/209:25:472
1369199230,22cyclictest7848-21diskmemload12:37:292
1369199230,22cyclictest7673-21rm10:34:202
1369199230,22cyclictest541-21ssh11:25:472
1369199230,22cyclictest28992-21rm12:19:292
1369199230,22cyclictest271rcuc/210:12:272
1369199230,22cyclictest13416-21rm09:14:272
1369199230,22cyclictest11538-21apt-get11:07:262
1369199230,1cyclictest6517-21ssh09:37:262
1369199230,1cyclictest1239-21ssh10:01:022
1369199230,1cyclictest0-21swapper/211:57:072
1369199230,0cyclictest0-21swapper/211:30:442
13686992323,0cyclictest0-21swapper/112:39:411
13686992323,0cyclictest0-21swapper/111:51:171
13686992323,0cyclictest0-21swapper/111:30:291
13686992323,0cyclictest0-21swapper/110:25:421
13686992323,0cyclictest0-21swapper/109:34:341
13686992322,1cyclictest7848-21diskmemload09:55:241
13686992321,1cyclictest0-21swapper/112:32:291
13686992321,1cyclictest0-21swapper/108:10:011
13686992321,1cyclictest0-21swapper/107:45:001
13686992320,2cyclictest19482-21rm11:13:151
1368699231,22cyclictest22-21ksoftirqd/110:12:271
1368699230,23cyclictest0-21swapper/112:06:281
1368699230,23cyclictest0-21swapper/112:00:501
1368699230,23cyclictest0-21swapper/111:28:211
1368699230,23cyclictest0-21swapper/111:06:581
1368699230,22cyclictest591-21awk08:55:011
1368699230,22cyclictest2272-21sh11:56:051
1368699230,22cyclictest0-21swapper/112:16:131
1368699230,22cyclictest0-21swapper/109:50:391
1368699230,1cyclictest0-21swapper/111:02:331
1368699230,1cyclictest0-21swapper/111:02:331
1368699230,0cyclictest0-21swapper/112:12:001
1368699230,0cyclictest0-21swapper/110:49:411
1368699230,0cyclictest0-21swapper/110:09:101
1368699230,0cyclictest0-21swapper/109:40:331
13682992323,0cyclictest7848-21diskmemload11:17:140
13682992323,0cyclictest0-21swapper/011:50:460
13682992323,0cyclictest0-21swapper/010:21:560
13682992323,0cyclictest0-21swapper/009:15:290
13682992321,1cyclictest917-21apt-get09:32:280
13682992321,1cyclictest0-21swapper/011:39:110
13682992321,1cyclictest0-21swapper/010:38:450
1368299231,21cyclictest783-21snmpd12:26:530
1368299230,23cyclictest0-21swapper/011:06:320
1368299230,22cyclictest7848-21diskmemload09:45:440
1368299230,22cyclictest31601-21sh10:55:540
1368299230,22cyclictest31199-21sh10:27:150
1368299230,22cyclictest21313-21ssh10:47:170
1368299230,22cyclictest0-21swapper/012:17:380
1368299230,22cyclictest0-21swapper/012:02:290
1368299230,22cyclictest0-21swapper/010:03:520
1368299230,22cyclictest0-21swapper/009:10:200
1368299230,1cyclictest6701-21ssh11:31:260
1368299230,1cyclictest0-21swapper/011:10:280
1368299230,0cyclictest34642sleep010:30:550
1368299230,0cyclictest0-21swapper/010:52:080
13692992222,0cyclictest7848-21diskmemload12:11:093
13692992222,0cyclictest0-21swapper/310:46:533
13692992222,0cyclictest0-21swapper/309:50:123
13692992221,0cyclictest8970-21ssh10:35:393
13692992221,0cyclictest0-21swapper/310:04:523
1369299220,22cyclictest17957-21sh11:41:293
1369299220,21cyclictest21257-21ssh09:21:323
1369299220,1cyclictest0-21swapper/309:30:063
13691992222,0cyclictest0-21swapper/211:17:062
13691992222,0cyclictest0-21swapper/210:26:102
13691992222,0cyclictest0-21swapper/209:50:422
13691992220,1cyclictest8939-21apt-get12:02:282
13691992220,1cyclictest0-21swapper/210:55:072
1369199220,21cyclictest28224-21perf08:45:012
1369199220,21cyclictest21702-21apt-get07:27:262
1369199220,21cyclictest0-21swapper/210:37:002
1369199220,21cyclictest0-21swapper/209:15:072
1369199220,1cyclictest0-21swapper/211:12:102
1369199220,0cyclictest0-21swapper/212:25:102
13686992222,0cyclictest0-21swapper/112:25:191
13686992222,0cyclictest0-21swapper/110:35:211
13686992222,0cyclictest0-21swapper/109:25:111
13686992220,1cyclictest0-21swapper/110:17:371
1368699220,22cyclictest0-21swapper/110:03:311
1368699220,21cyclictest0-21swapper/111:40:471
1368699220,21cyclictest0-21swapper/110:30:151
1368699220,1cyclictest0-21swapper/111:39:291
1368699220,0cyclictest0-21swapper/110:40:101
13682992222,0cyclictest0-21swapper/009:55:070
13682992222,0cyclictest0-21swapper/009:27:400
13682992221,1cyclictest23048-21ssh09:51:560
13682992221,0cyclictest0-21swapper/007:27:270
13682992220,1cyclictest30194-21ssh12:20:090
1368299220,21cyclictest8612-21grep08:05:010
1368299220,21cyclictest7848-21diskmemload10:15:090
1368299220,21cyclictest22035-21rm12:12:420
1368299220,21cyclictest0-21swapper/011:45:230
1368299220,21cyclictest0-21swapper/007:52:260
1368299220,21cyclictest0-21swapper/007:47:260
1368299220,21cyclictest0-21swapper/007:37:270
1368299220,1cyclictest11993-21ssh10:10:160
1369299210,21cyclictest7848-21diskmemload10:15:193
1369299210,20cyclictest0-21swapper/307:32:273
1369299210,1cyclictest3068-21sendmail-msp09:00:013
1369299210,0cyclictest18660-21apt-get08:27:273
13691992120,1cyclictest26496-21apt-get07:37:272
13691992120,1cyclictest0-21swapper/209:30:082
13691992120,1cyclictest0-21swapper/208:27:272
13686992121,0cyclictest0-21swapper/107:52:261
13686992119,1cyclictest23662-21basename07:30:001
1368699210,0cyclictest0-21swapper/108:42:271
13682992121,0cyclictest0-21swapper/008:37:260
1368299210,1cyclictest14100-21apt-get07:12:270
1368299210,0cyclictest0-21swapper/008:52:270
13692992020,0cyclictest16891-21apt-get07:17:263
13692992020,0cyclictest0-21swapper/308:23:403
13692992019,1cyclictest3510-21apt-get09:02:273
13692992018,1cyclictest11445-21apt-get08:12:263
1369299200,20cyclictest0-21swapper/308:35:023
1369299200,20cyclictest0-21swapper/307:40:023
1369299200,0cyclictest0-21swapper/307:47:273
1369299200,0cyclictest0-21swapper/307:27:273
13691992020,0cyclictest0-21swapper/207:32:272
13691992018,1cyclictest0-21swapper/208:05:012
1369199200,19cyclictest0-21swapper/208:47:242
13686992020,0cyclictest0-21swapper/107:12:271
1368699200,20cyclictest0-21swapper/107:37:271
13682992020,0cyclictest5906-21apt-get09:07:270
13682992020,0cyclictest0-21swapper/007:17:270
13682992019,0cyclictest1082-21apt-get08:57:270
13682992018,1cyclictest28220-21apt08:45:010
13692991919,0cyclictest1843-21apt-get07:52:263
13692991919,0cyclictest0-21swapper/309:07:273
13692991917,1cyclictest10973-21cron08:10:013
1369299190,18cyclictest0-21swapper/308:32:283
13691991919,0cyclictest0-21swapper/209:02:282
13691991919,0cyclictest0-21swapper/208:22:262
13691991919,0cyclictest0-21swapper/208:07:282
13691991918,1cyclictest6217-21perf08:00:012
13691991918,1cyclictest6217-21perf08:00:012
13691991917,1cyclictest29467-21apt-get07:42:262
13686991919,0cyclictest0-21swapper/109:10:001
13686991919,0cyclictest0-21swapper/108:22:261
13686991919,0cyclictest0-21swapper/107:17:261
13686991917,1cyclictest0-21swapper/108:00:011
13686991917,1cyclictest0-21swapper/108:00:011
13682991919,0cyclictest0-21swapper/008:27:270
13691991818,0cyclictest23012-21apt-get08:35:022
13691991818,0cyclictest0-21swapper/208:32:282
13691991816,1cyclictest0-21swapper/209:00:012
13691991816,1cyclictest0-21swapper/207:25:012
13686991818,0cyclictest18660-21apt-get08:27:271
13686991818,0cyclictest0-21swapper/108:57:261
13682991818,0cyclictest0-21swapper/009:02:270
13682991818,0cyclictest0-21swapper/008:12:260
13682991818,0cyclictest0-21swapper/007:57:270
13682991818,0cyclictest0-21swapper/007:57:270
1369299170,17cyclictest0-21swapper/308:47:243
13686991717,0cyclictest0-21swapper/108:35:021
13682991717,0cyclictest9053-21apt-get08:07:280
13682991717,0cyclictest0-21swapper/008:17:270
13692991616,0cyclictest0-21swapper/308:02:263
13691991614,2cyclictest0-21swapper/208:11:372
13686991616,0cyclictest21061-21apt-get08:32:281
13686991616,0cyclictest0-21swapper/108:02:261
13686991615,0cyclictest0-21swapper/109:02:271
1368299160,2cyclictest24650-21perl07:32:290
13692991514,1cyclictest31109-21apt-get08:52:273
13692991513,1cyclictest16055-21turbostat07:15:013
13692991512,2cyclictest28638-21idleruntime-cro07:40:003
13691991515,0cyclictest0-21swapper/207:17:262
13682991515,0cyclictest0-21swapper/007:40:020
13692991414,0cyclictest0-21swapper/307:20:203
1369299140,0cyclictest0-21swapper/308:40:453
1369299140,0cyclictest0-21swapper/308:15:303
1369299140,0cyclictest0-21swapper/307:55:343
1369299140,0cyclictest0-21swapper/307:55:343
1369199140,14cyclictest0-21swapper/209:05:032
1369199140,14cyclictest0-21swapper/208:15:222
1369199140,14cyclictest0-21swapper/207:45:112
1369199140,14cyclictest0-21swapper/207:10:592
1369199140,0cyclictest0-21swapper/208:50:162
1369199140,0cyclictest0-21swapper/207:50:232
13686991414,0cyclictest0-21swapper/108:45:121
1368699140,14cyclictest0-21swapper/108:10:041
1368699140,14cyclictest0-21swapper/107:30:181
13682991414,0cyclictest0-21swapper/007:20:430
1368299140,14cyclictest0-21swapper/008:45:100
1368299140,14cyclictest0-21swapper/008:30:520
1368299140,14cyclictest0-21swapper/008:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional