You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 16:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Sep 18, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26370992624,1cyclictest0-21swapper/312:27:113
26370992520,3cyclictest313-21systemd-journal08:15:003
2637099250,24cyclictest0-21swapper/312:18:573
2637099250,24cyclictest0-21swapper/310:47:573
2637099250,1cyclictest32765-21sh09:51:053
2636399250,24cyclictest13988-21sh11:31:220
26370992423,1cyclictest14683-21ssh11:32:243
26370992422,1cyclictest606-21dbus-daemon10:30:003
26370992422,1cyclictest30475-21sh09:18:593
2637099240,24cyclictest3398-1kworker/u9:110:02:143
2637099240,23cyclictest19741-21diskmemload09:20:403
26365992423,1cyclictest19741-21diskmemload10:12:592
26365992422,1cyclictest12506-21wc08:55:002
26365992422,1cyclictest0-21swapper/209:42:592
26365992421,2cyclictest19995-21ssh09:10:012
26365992419,0cyclictest0-21swapper/210:23:192
2636599240,24cyclictest19741-21diskmemload09:35:382
2636599240,24cyclictest0-21swapper/212:39:512
2636599240,23cyclictest19741-21diskmemload10:58:492
2636599240,23cyclictest0-21swapper/212:03:092
2636599240,23cyclictest0-21swapper/211:35:472
2636599240,1cyclictest21835-21cron10:40:002
2636599240,0cyclictest0-21swapper/212:17:362
26364992424,0cyclictest19741-21diskmemload10:27:211
26364992423,0cyclictest0-21swapper/112:35:141
2636499240,24cyclictest0-21swapper/109:43:541
2636499240,23cyclictest510-21apt-get08:32:331
2636499240,23cyclictest0-21swapper/111:06:351
2636499240,23cyclictest0-21swapper/110:49:171
26363992424,0cyclictest0-21swapper/009:10:130
26363992423,1cyclictest19741-21diskmemload12:23:590
26363992421,2cyclictest0-21swapper/009:44:140
2636399240,24cyclictest62550irq/127-eno110:17:440
2636399240,24cyclictest0-21swapper/009:15:120
2636399240,23cyclictest0-21swapper/012:08:490
2636399240,23cyclictest0-21swapper/011:50:420
2636399240,23cyclictest0-21swapper/009:25:140
2636399240,22cyclictest313-21systemd-journal12:00:000
2636399240,0cyclictest0-21swapper/010:29:210
2636399240,0cyclictest0-21swapper/010:11:480
26370992323,0cyclictest19741-21diskmemload11:41:143
26370992323,0cyclictest19741-21diskmemload10:11:483
26370992323,0cyclictest19741-21diskmemload09:28:573
26370992322,0cyclictest0-21swapper/312:33:163
26370992321,1cyclictest606-21dbus-daemon11:55:003
2637099230,22cyclictest7052-21perf11:25:003
2637099230,22cyclictest29555-21ssh10:17:393
2637099230,22cyclictest19741-21diskmemload11:37:393
2637099230,22cyclictest15838-21ssh10:34:073
2637099230,22cyclictest14913-21sendmail-msp09:00:003
2637099230,22cyclictest0-21swapper/312:35:493
2637099230,0cyclictest0-21swapper/311:58:593
26365992323,0cyclictest19741-21diskmemload11:42:312
26365992323,0cyclictest19741-21diskmemload09:55:572
26365992323,0cyclictest0-21swapper/212:25:322
26365992323,0cyclictest0-21swapper/211:48:392
26365992323,0cyclictest0-21swapper/210:28:172
26365992321,1cyclictest0-21swapper/210:47:402
26365992320,2cyclictest7127-21ssh12:23:282
26365992320,2cyclictest25208-21ssh12:11:022
2636599230,23cyclictest0-21swapper/211:51:242
2636599230,23cyclictest0-21swapper/211:17:192
2636599230,23cyclictest0-21swapper/210:53:322
2636599230,23cyclictest0-21swapper/209:22:082
2636599230,23cyclictest0-21swapper/209:15:432
2636599230,22cyclictest8420-21ssh11:55:242
2636599230,22cyclictest27712-21perf08:20:012
2636599230,22cyclictest19741-21diskmemload11:28:042
2636599230,22cyclictest19741-21diskmemload11:10:282
2636599230,0cyclictest0-21swapper/212:30:302
2636599230,0cyclictest0-21swapper/209:50:472
2636599230,0cyclictest0-21swapper/209:33:322
26364992323,0cyclictest19741-21diskmemload09:23:521
26364992322,1cyclictest15550-21ssh10:33:451
26364992321,1cyclictest12997-21ssh11:01:151
26364992321,1cyclictest0-21swapper/109:25:131
26364992321,1cyclictest0-21swapper/108:00:001
2636499230,23cyclictest0-21swapper/109:36:021
2636499230,22cyclictest6935-21ssh11:53:381
2636499230,22cyclictest546-21ssh09:51:241
2636499230,22cyclictest24485-21ssh12:10:071
2636499230,22cyclictest19741-21diskmemload12:05:031
2636499230,22cyclictest15526-21ssh12:32:121
2636499230,22cyclictest15393-21apt-get12:02:371
2636499230,22cyclictest15158-21sh09:34:411
2636499230,1cyclictest0-21swapper/109:57:331
2636499230,0cyclictest0-21swapper/111:30:011
2636499230,0cyclictest0-21swapper/110:22:391
2636499230,0cyclictest0-21swapper/110:15:031
2636499230,0cyclictest0-21swapper/109:46:141
26363992323,0cyclictest19741-21diskmemload12:03:010
26363992323,0cyclictest0-21swapper/012:28:390
26363992323,0cyclictest0-21swapper/011:41:140
26363992323,0cyclictest0-21swapper/011:14:360
26363992323,0cyclictest0-21swapper/010:24:520
26363992322,1cyclictest62550irq/127-eno110:40:240
26363992322,1cyclictest21627-21ssh11:08:090
26363992322,1cyclictest19741-21diskmemload12:31:350
26363992322,1cyclictest0-21swapper/012:16:520
26363992322,1cyclictest0-21swapper/009:30:300
26363992321,1cyclictest5979-21ssh10:55:010
26363992321,1cyclictest19775-21munin-run09:10:010
26363992321,1cyclictest0-21swapper/010:47:400
26363992321,1cyclictest0-21swapper/010:37:120
2636399231,21cyclictest19741-21diskmemload09:45:100
2636399230,2cyclictest11971-21ssh10:31:060
2636399230,23cyclictest19741-21diskmemload11:46:080
2636399230,23cyclictest0-21swapper/012:13:260
2636399230,22cyclictest8042-21ssh09:57:410
2636399230,22cyclictest30410-21sh11:17:290
2636399230,22cyclictest25287-21awk08:15:000
2636399230,22cyclictest23480-21sh12:38:240
2636399230,22cyclictest15819-21ssh09:35:110
2636399230,0cyclictest0-21swapper/011:28:290
2636399230,0cyclictest0-21swapper/011:24:260
2636399230,0cyclictest0-21swapper/011:01:450
26370992222,0cyclictest19741-21diskmemload12:13:263
26370992222,0cyclictest19741-21diskmemload11:28:293
26370992222,0cyclictest0-21swapper/312:02:413
26370992222,0cyclictest0-21swapper/311:11:293
26370992222,0cyclictest0-21swapper/311:01:453
26370992222,0cyclictest0-21swapper/309:57:063
26370992222,0cyclictest0-21swapper/309:48:093
26370992222,0cyclictest0-21swapper/309:10:133
26370992220,1cyclictest28734-21cron07:15:003
26370992220,1cyclictest22594-21sh10:40:363
26370992220,1cyclictest0-21swapper/309:30:453
2637099220,22cyclictest19741-21diskmemload10:22:513
2637099220,21cyclictest18634-21sh11:06:223
2637099220,21cyclictest0-21swapper/311:45:343
2637099220,21cyclictest0-21swapper/310:56:113
2637099220,21cyclictest0-21swapper/310:35:173
2637099220,21cyclictest0-21swapper/308:47:353
2637099220,21cyclictest0-21swapper/307:22:363
2637099220,1cyclictest19746-21sh12:06:023
2637099220,0cyclictest0-21swapper/312:20:563
26365992222,0cyclictest0-21swapper/210:44:052
26365992221,1cyclictest0-21swapper/209:49:472
26365992220,1cyclictest0-21swapper/212:05:412
2636599220,22cyclictest0-21swapper/210:19:212
2636599220,22cyclictest0-21swapper/209:25:492
2636599220,21cyclictest2501-21awk08:35:012
2636599220,21cyclictest16159-21apt-get07:57:352
2636599220,21cyclictest14924-21awk09:00:002
2636599220,21cyclictest11316-21ssh10:01:002
2636599220,1cyclictest0-21swapper/211:07:412
2636599220,1cyclictest0-21swapper/210:32:102
2636599220,0cyclictest19741-21diskmemload11:21:172
2636599220,0cyclictest0-21swapper/210:08:372
26364992222,0cyclictest0-21swapper/110:40:591
26364992220,1cyclictest0-21swapper/110:36:071
2636499220,22cyclictest0-21swapper/112:20:451
2636499220,21cyclictest8168-21apt-get08:47:351
2636499220,21cyclictest7230-21cat11:25:001
2636499220,21cyclictest6560-21ssh10:55:251
2636499220,21cyclictest30600-21ssh12:15:541
2636499220,21cyclictest24219-21ssh11:11:301
2636499220,21cyclictest19741-21diskmemload10:05:251
2636499220,21cyclictest18936-21ssh11:35:351
2636499220,21cyclictest1426-21ssh10:50:531
2636499220,21cyclictest10662-21df_inode12:27:371
2636499220,1cyclictest22153-21ssh10:10:431
2636499220,1cyclictest0-21swapper/111:44:141
2636499220,1cyclictest0-21swapper/111:15:471
2636499220,0cyclictest0-21swapper/111:56:141
2636499220,0cyclictest0-21swapper/111:27:371
26363992222,0cyclictest0-21swapper/009:53:170
26363992222,0cyclictest0-21swapper/009:22:370
26363992222,0cyclictest0-21swapper/007:27:360
26363992221,1cyclictest62550irq/127-eno110:57:060
2636399220,21cyclictest0-21swapper/010:08:500
2636399220,21cyclictest0-21swapper/008:42:360
2636399220,1cyclictest0-21swapper/010:00:320
26370992121,0cyclictest0-21swapper/310:50:083
26370992120,1cyclictest0-21swapper/311:16:403
2637099210,20cyclictest0-21swapper/309:35:333
2637099210,20cyclictest0-21swapper/308:52:373
2637099210,20cyclictest0-21swapper/308:32:333
2637099210,1cyclictest0-21swapper/308:35:023
2637099210,0cyclictest0-21swapper/307:37:353
26365992120,1cyclictest31620-21apt-get07:22:362
26365992120,1cyclictest26806-21apt-get07:12:362
26365992119,1cyclictest19741-21diskmemload11:00:062
2636599210,21cyclictest0-21swapper/211:30:092
2636599210,20cyclictest0-21swapper/208:05:002
2636599210,20cyclictest0-21swapper/207:17:352
2636599210,1cyclictest6501-21apt-get07:37:352
2636599210,0cyclictest5775-21apt-get08:42:362
2636599210,0cyclictest0-21swapper/207:42:352
26364992119,1cyclictest5302-21perf08:40:001
2636499210,21cyclictest0-21swapper/110:00:341
2636499210,20cyclictest0-21swapper/108:27:361
2636499210,1cyclictest19741-21diskmemload11:45:161
26363992121,0cyclictest0-21swapper/007:17:350
26363992120,1cyclictest0-21swapper/008:35:020
26363992120,0cyclictest18574-21apt-get08:02:350
2636399210,0cyclictest0-21swapper/008:22:360
26370992020,0cyclictest0-21swapper/308:42:363
26370992020,0cyclictest0-21swapper/308:22:363
26370992019,0cyclictest0-21swapper/307:27:363
26370992019,0cyclictest0-21swapper/307:17:353
2637099200,19cyclictest0-21swapper/309:02:383
26365992020,0cyclictest0-21swapper/208:37:342
26364992020,0cyclictest4000-21apt-get07:32:351
26364992020,0cyclictest0-21swapper/107:42:351
2636499200,0cyclictest0-21swapper/108:02:351
26363992020,0cyclictest0-21swapper/008:47:350
26363992020,0cyclictest0-21swapper/007:42:350
26363992019,0cyclictest0-21swapper/008:17:350
26363992017,2cyclictest8435-21idleruntime-cro07:40:010
26363992017,2cyclictest2500-21latency_hist08:35:010
26370991918,1cyclictest8920-21apt-get07:42:353
26370991918,0cyclictest0-21swapper/308:02:353
26365991919,0cyclictest0-21swapper/208:22:362
26365991919,0cyclictest0-21swapper/207:32:362
26365991917,1cyclictest13710-21apt-get07:52:352
26364991919,0cyclictest29201-21apt-get07:17:351
26364991919,0cyclictest0-21swapper/108:57:351
26364991919,0cyclictest0-21swapper/108:17:351
26363991918,0cyclictest20971-21apt-get08:07:360
26363991917,1cyclictest5949-21grep07:35:010
26370991818,0cyclictest0-21swapper/309:10:013
26364991818,0cyclictest0-21swapper/109:05:001
26364991818,0cyclictest0-21swapper/108:12:371
26364991818,0cyclictest0-21swapper/108:10:001
26364991818,0cyclictest0-21swapper/107:52:351
26364991818,0cyclictest0-21swapper/107:47:341
26364991818,0cyclictest0-21swapper/107:22:371
26363991818,0cyclictest0-21swapper/007:22:370
26363991817,1cyclictest11314-21apt-get07:47:340
26364991717,0cyclictest0-21swapper/108:22:361
26370991616,0cyclictest0-21swapper/308:17:353
26370991615,0cyclictest0-21swapper/308:07:363
2637099160,1cyclictest313-21systemd-journal07:34:563
26365991615,1cyclictest0-21swapper/207:47:342
2636499160,1cyclictest8477-21munin-run07:40:011
26363991616,0cyclictest0-21swapper/008:52:370
26365991510,4cyclictest1593-21apt-get07:27:352
26364991515,0cyclictest0-21swapper/108:42:361
26364991515,0cyclictest0-21swapper/107:12:361
26370991414,0cyclictest0-21swapper/307:50:543
2637099140,14cyclictest0-21swapper/308:25:383
2637099140,14cyclictest0-21swapper/307:57:233
2637099140,14cyclictest0-21swapper/307:46:553
2636599140,14cyclictest0-21swapper/209:05:332
2636599140,14cyclictest0-21swapper/208:46:092
2636599140,0cyclictest0-21swapper/209:00:442
2636599140,0cyclictest0-21swapper/208:25:372
2636599140,0cyclictest0-21swapper/208:07:002
2636499140,0cyclictest0-21swapper/107:25:391
2636399140,14cyclictest0-21swapper/008:55:390
2636399140,14cyclictest0-21swapper/008:26:540
2636399140,14cyclictest0-21swapper/007:55:080
2636399140,0cyclictest0-21swapper/009:00:460
2636399140,0cyclictest0-21swapper/007:51:160
2636399140,0cyclictest0-21swapper/007:11:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional