You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 21:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Jul 14, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1361599300,3cyclictest25560-21dump-pmu-power07:35:013
13615992721,5cyclictest0-21swapper/310:38:173
1361599270,1cyclictest0-21swapper/312:06:403
1361599270,1cyclictest0-21swapper/310:00:383
13615992620,5cyclictest26376-21ssh10:24:443
1361599260,2cyclictest31492-21ssh10:28:543
1361599260,1cyclictest6004-21munin-run10:35:013
1361599260,0cyclictest0-21swapper/311:49:403
1361599260,0cyclictest0-21swapper/309:58:053
1360999260,25cyclictest11549-21sh09:42:141
13615992521,3cyclictest0-21swapper/310:50:263
13615992520,4cyclictest0-21swapper/312:24:313
13615992519,5cyclictest6946-21diskmemload11:36:573
1361599250,24cyclictest0-21swapper/311:01:393
1361599250,21cyclictest6946-21diskmemload10:10:293
1361599250,0cyclictest0-21swapper/312:13:593
1361599250,0cyclictest0-21swapper/311:59:533
1361599250,0cyclictest0-21swapper/311:59:533
13614992523,1cyclictest6946-21diskmemload11:58:532
13614992523,1cyclictest6946-21diskmemload11:58:532
13614992523,1cyclictest21017-21apt10:20:002
13614992523,1cyclictest0-21swapper/211:37:552
1361499250,24cyclictest0-21swapper/212:18:152
1361499250,1cyclictest0-21swapper/211:49:492
13609992523,1cyclictest0-21swapper/110:17:511
13609992523,1cyclictest0-21swapper/109:37:191
1360999250,24cyclictest26733-21ssh11:22:161
1360999250,24cyclictest1518-21ssh12:26:151
13604992524,1cyclictest6946-21diskmemload10:15:580
1360499250,24cyclictest13041-21cron09:15:000
13615992422,2cyclictest0-21swapper/311:31:093
13615992419,4cyclictest6946-21diskmemload12:35:203
13615992419,4cyclictest0-21swapper/309:10:443
13615992418,5cyclictest746-21ssh12:25:083
1361599240,24cyclictest0-21swapper/309:38:353
1361599240,23cyclictest0-21swapper/310:55:163
1361599240,23cyclictest0-21swapper/309:30:543
1361599240,23cyclictest0-21swapper/309:15:103
1361599240,20cyclictest0-21swapper/312:30:413
1361599240,0cyclictest0-21swapper/311:52:053
1361599240,0cyclictest0-21swapper/311:19:543
1361599240,0cyclictest0-21swapper/310:07:593
13614992423,1cyclictest6946-21diskmemload11:25:362
13614992423,1cyclictest0-21swapper/211:21:382
13614992421,2cyclictest6946-21diskmemload11:08:402
1361499240,24cyclictest0-21swapper/211:40:582
1361499240,23cyclictest31152-21sendmail10:00:002
1361499240,23cyclictest0-21swapper/212:27:302
1361499240,23cyclictest0-21swapper/212:02:102
1361499240,23cyclictest0-21swapper/211:52:492
1361499240,23cyclictest0-21swapper/210:36:532
1361499240,23cyclictest0-21swapper/210:00:282
1361499240,1cyclictest0-21swapper/212:23:042
13609992423,1cyclictest0-21swapper/110:46:231
13609992422,1cyclictest25662-21rm09:26:451
1360999240,24cyclictest6946-21diskmemload11:04:491
1360999240,24cyclictest22000-21kworker/u8:210:30:271
1360999240,24cyclictest0-21swapper/110:40:051
1360999240,23cyclictest24851-21df_inode10:52:121
1360999240,23cyclictest18388-21idleruntime-cro07:20:011
1360999240,0cyclictest16337-21ssh12:10:111
1360999240,0cyclictest0-21swapper/110:37:221
1360999240,0cyclictest0-21swapper/110:13:181
13604992423,1cyclictest62550irq/127-eno109:54:110
1360499240,24cyclictest6946-21diskmemload10:50:100
1360499240,23cyclictest6946-21diskmemload11:22:040
1360499240,0cyclictest0-21swapper/011:09:450
13615992323,0cyclictest0-21swapper/312:15:043
13615992323,0cyclictest0-21swapper/310:45:433
13615992323,0cyclictest0-21swapper/309:50:233
13615992320,3cyclictest0-21swapper/311:23:173
13615992320,3cyclictest0-21swapper/310:15:353
13615992320,2cyclictest15520-21sh09:46:273
13615992319,4cyclictest0-21swapper/312:01:363
13615992319,3cyclictest5328-21perf08:00:003
1361599230,23cyclictest0-21swapper/311:25:293
1361599230,23cyclictest0-21swapper/310:40:493
1361599230,23cyclictest0-21swapper/309:26:113
1361599230,1cyclictest9344-21ssh09:40:383
1361599230,0cyclictest0-21swapper/309:23:043
13614992323,0cyclictest0-21swapper/210:56:122
13614992323,0cyclictest0-21swapper/210:45:082
13614992323,0cyclictest0-21swapper/210:05:202
13614992321,1cyclictest5689-21ssh11:32:162
13614992321,1cyclictest0-21swapper/211:10:012
13614992321,1cyclictest0-21swapper/209:37:352
13614992320,2cyclictest7605-21apt-get09:10:022
13614992320,2cyclictest21345-21ssh12:14:422
1361499231,21cyclictest271rcuc/209:21:162
1361499230,23cyclictest0-21swapper/210:43:202
1361499230,22cyclictest0-21swapper/212:30:542
1361499230,22cyclictest0-21swapper/210:11:542
1361499230,1cyclictest0-21swapper/209:53:212
1361499230,1cyclictest0-21swapper/209:31:472
1361499230,0cyclictest0-21swapper/212:35:402
1361499230,0cyclictest0-21swapper/210:51:442
13609992323,0cyclictest6946-21diskmemload12:17:251
13609992323,0cyclictest6946-21diskmemload12:06:041
13609992323,0cyclictest0-21swapper/112:31:121
13609992323,0cyclictest0-21swapper/110:00:461
13609992321,1cyclictest6946-21diskmemload11:47:121
13609992321,1cyclictest15947-21latency_hist07:15:011
13609992321,1cyclictest15924-21ssh11:42:101
13609992321,1cyclictest0-21swapper/111:50:121
13609992321,1cyclictest0-21swapper/110:24:501
13609992320,2cyclictest14995-21ssh09:45:381
1360999230,23cyclictest0-21swapper/112:00:351
1360999230,23cyclictest0-21swapper/109:53:161
1360999230,23cyclictest0-21swapper/109:17:051
1360999230,22cyclictest6946-21diskmemload09:22:431
1360999230,22cyclictest4053-21sh11:31:341
1360999230,22cyclictest30674-21ssh09:30:451
1360999230,22cyclictest0-21swapper/109:11:531
1360999230,1cyclictest8412-21sh11:06:361
1360999230,1cyclictest0-21swapper/110:27:221
1360999230,0cyclictest0-21swapper/111:27:101
13604992323,0cyclictest6946-21diskmemload11:35:040
13604992323,0cyclictest0-21swapper/012:11:090
13604992323,0cyclictest0-21swapper/010:37:100
13604992323,0cyclictest0-21swapper/009:40:250
13604992322,1cyclictest6946-21diskmemload11:30:340
13604992322,1cyclictest13975-21apt-get07:12:070
1360499232,1cyclictest62550irq/127-eno109:16:270
13604992321,1cyclictest18963-21ssh11:15:430
13604992321,1cyclictest17699-21cron08:25:000
13604992321,1cyclictest0-21swapper/008:45:000
13604992320,2cyclictest30104-21ssh10:57:120
1360499230,2cyclictest7916-21diskmemload09:38:570
1360499230,2cyclictest15302-21ssh11:41:260
1360499230,23cyclictest0-21swapper/012:15:230
1360499230,23cyclictest0-21swapper/010:25:480
1360499230,23cyclictest0-21swapper/010:01:050
1360499230,23cyclictest0-21swapper/009:32:460
1360499230,22cyclictest6946-21diskmemload10:13:300
1360499230,22cyclictest6398-21ssh12:30:180
1360499230,22cyclictest12155-21sh12:07:070
1360499230,22cyclictest0-21swapper/010:46:350
1360499230,0cyclictest0-21swapper/012:36:550
1360499230,0cyclictest0-21swapper/012:29:080
1360499230,0cyclictest0-21swapper/012:03:580
1360499230,0cyclictest0-21swapper/011:50:190
1360499230,0cyclictest0-21swapper/011:10:320
13615992222,0cyclictest0-21swapper/311:08:293
13615992220,1cyclictest0-21swapper/311:44:213
13615992220,1cyclictest0-21swapper/308:05:013
13615992219,2cyclictest28122-21grep07:40:003
13615992219,2cyclictest17725-21awk08:25:003
1361599220,21cyclictest30525-21idleruntime-cro07:45:003
1361599220,21cyclictest0-21swapper/308:27:113
1361599220,21cyclictest0-21swapper/307:55:003
1361599220,0cyclictest6946-21diskmemload11:10:443
13614992221,1cyclictest6946-21diskmemload09:46:032
13614992221,1cyclictest0-21swapper/208:22:072
13614992221,1cyclictest0-21swapper/208:00:022
13614992220,1cyclictest25558-21latency_hist07:35:012
13614992220,1cyclictest24932-21perf08:40:002
13614992220,1cyclictest0-21swapper/208:12:092
1361499220,21cyclictest20438-21df_inode11:17:102
1361499220,21cyclictest0-21swapper/210:30:072
1361499220,21cyclictest0-21swapper/210:21:492
1361499220,1cyclictest0-21swapper/212:05:022
1361499220,1cyclictest0-21swapper/211:02:222
1361499220,1cyclictest0-21swapper/209:41:152
1361499220,0cyclictest6946-21diskmemload09:26:032
1361499220,0cyclictest0-21swapper/210:25:082
1361499220,0cyclictest0-21swapper/209:16:442
13609992222,0cyclictest0-21swapper/110:57:371
13609992220,1cyclictest8107-21idleruntime-cro08:05:011
13609992220,1cyclictest606-21dbus-daemon08:30:001
13609992220,1cyclictest0-21swapper/109:57:481
1360999220,22cyclictest622-21gdbus11:40:001
1360999220,21cyclictest12475-21ssh12:35:291
1360999220,21cyclictest0-21swapper/108:47:091
1360999220,21cyclictest0-21swapper/108:12:091
1360999220,21cyclictest0-21swapper/107:30:011
1360999220,1cyclictest6946-21diskmemload11:17:101
1360999220,1cyclictest12921-21ssh11:10:041
1360999220,1cyclictest0-21swapper/112:22:001
13604992221,1cyclictest19299-21ssh09:20:390
13604992220,1cyclictest25204-21awk11:50:000
1360499221,21cyclictest5498-21rm10:06:250
1360499221,21cyclictest13-21ksoftirqd/009:57:300
1360499220,22cyclictest0-21swapper/011:01:010
1360499220,22cyclictest0-21swapper/010:32:530
1360499220,22cyclictest0-21swapper/009:25:250
1360499220,21cyclictest23585-21apt-get07:32:080
1360499220,21cyclictest18362-21tr07:20:010
1360499220,21cyclictest11715-21ssh10:40:010
1360499220,21cyclictest0-21swapper/007:47:100
1360499220,1cyclictest31801-21ssh12:23:340
1360499220,1cyclictest24252-21ssh10:22:170
1360499220,1cyclictest15814-21ssh09:46:500
13615992119,1cyclictest27750-21apt-get08:47:093
1361599210,0cyclictest0-21swapper/308:37:083
13614992121,0cyclictest0-21swapper/208:52:092
1361499210,20cyclictest0-21swapper/207:42:082
1361499210,0cyclictest0-21swapper/207:52:112
13609992121,0cyclictest30895-21apt-get11:55:021
13609992121,0cyclictest30895-21apt-get11:55:021
13609992121,0cyclictest0-21swapper/108:32:101
1360999210,21cyclictest0-21swapper/110:05:161
1360999210,20cyclictest28552-21apt-get07:42:091
1360999210,0cyclictest0-21swapper/109:02:091
13604992120,1cyclictest2598-21apt-get09:02:090
13604992119,1cyclictest32185-21munin-run08:55:010
1360499210,0cyclictest21190-21apt-get07:27:100
1360499210,0cyclictest0-21swapper/011:55:010
1360499210,0cyclictest0-21swapper/011:55:010
1360499210,0cyclictest0-21swapper/008:37:080
1361599200,4cyclictest18326-21cron07:20:013
1361599200,1cyclictest0-21swapper/307:12:093
1361599200,0cyclictest0-21swapper/309:07:103
1361599200,0cyclictest0-21swapper/308:52:093
13614992020,0cyclictest0-21swapper/207:37:102
13614992020,0cyclictest0-21swapper/207:12:072
13614992019,1cyclictest271rcuc/209:05:012
13609992020,0cyclictest0-21swapper/108:07:091
13609992020,0cyclictest0-21swapper/107:22:101
13609992018,1cyclictest0-21swapper/107:55:001
1360999200,20cyclictest0-21swapper/108:52:091
1360999200,0cyclictest0-21swapper/108:17:101
13604992020,0cyclictest0-21swapper/008:47:090
13604992020,0cyclictest0-21swapper/008:32:100
13604992020,0cyclictest0-21swapper/008:17:100
13604992020,0cyclictest0-21swapper/007:52:100
13604992018,1cyclictest26085-21apt-get07:37:100
1360499200,0cyclictest18796-21apt-get07:22:100
13615991918,1cyclictest0-21swapper/307:30:013
13614991918,1cyclictest0-21swapper/207:22:102
13604991919,0cyclictest0-21swapper/008:57:100
13604991919,0cyclictest0-21swapper/008:00:020
13604991919,0cyclictest0-21swapper/007:42:080
13604991918,1cyclictest10926-21apt-get08:12:080
13615991817,0cyclictest0-21swapper/308:07:093
13614991818,0cyclictest0-21swapper/208:57:102
13614991818,0cyclictest0-21swapper/207:27:102
13609991817,1cyclictest0-21swapper/107:47:101
13609991817,0cyclictest0-21swapper/108:57:101
13604991818,0cyclictest0-21swapper/007:57:080
1360499180,17cyclictest20105-21cron08:30:000
13615991717,0cyclictest0-21swapper/308:32:103
13615991717,0cyclictest0-21swapper/308:17:093
13615991716,1cyclictest0-21swapper/307:22:103
1361599170,5cyclictest0-21swapper/308:57:173
1361599170,0cyclictest0-21swapper/308:42:143
13614991717,0cyclictest0-21swapper/208:27:112
13615991616,0cyclictest0-21swapper/309:02:093
13614991612,3cyclictest17726-21mailstats07:17:162
1361499160,15cyclictest21169-21grep08:32:122
1361499160,15cyclictest10506-21perf08:10:012
1360999160,15cyclictest27059-21grep08:42:191
1361599150,14cyclictest0-21swapper/308:12:123
13614991515,0cyclictest0-21swapper/209:07:102
13614991515,0cyclictest0-21swapper/208:42:092
13614991514,0cyclictest0-21swapper/207:57:082
1361599140,14cyclictest0-21swapper/307:45:133
1361499140,14cyclictest0-21swapper/208:45:262
1361499140,14cyclictest0-21swapper/207:45:502
13609991414,0cyclictest0-21swapper/107:36:061
1360999140,14cyclictest0-21swapper/107:30:161
1360499140,0cyclictest0-21swapper/009:05:240
13614991313,0cyclictest0-21swapper/208:16:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional