You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-06 - 21:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Mar 06, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2231999250,24cyclictest17591-21diskmemload12:01:243
2231999250,1cyclictest17591-21diskmemload12:29:303
2231599250,24cyclictest25886-21ssh10:50:542
2231599250,24cyclictest17591-21diskmemload11:34:192
2231599250,1cyclictest17591-21diskmemload10:14:502
2231599250,1cyclictest17591-21diskmemload10:14:502
2231599250,0cyclictest0-21swapper/209:53:322
22313992523,1cyclictest8790-21ssh10:02:211
2231399250,24cyclictest0-21swapper/111:19:471
2230999250,2cyclictest4795-21diskmemload10:30:330
2230999250,24cyclictest17591-21diskmemload11:52:000
2230999250,24cyclictest0-21swapper/010:03:100
22319992422,1cyclictest0-21swapper/312:16:593
2231999242,1cyclictest17635-21sh09:40:463
2231999240,24cyclictest0-21swapper/310:45:183
2231999240,23cyclictest17591-21diskmemload11:31:133
2231999240,23cyclictest0-21swapper/311:46:193
22315992424,0cyclictest0-21swapper/211:45:332
22315992424,0cyclictest0-21swapper/210:33:282
22315992423,0cyclictest11613-21apt-get10:06:172
2231599240,23cyclictest28693-21ssh11:54:322
2231599240,23cyclictest0-21swapper/210:49:182
2231599240,1cyclictest17591-21diskmemload10:56:242
2231599240,0cyclictest20334-21apt-get11:16:192
22313992424,0cyclictest17591-21diskmemload10:44:201
22313992423,1cyclictest0-21swapper/109:41:011
22313992423,0cyclictest0-21swapper/107:11:191
2231399240,24cyclictest0-21swapper/111:39:391
2231399240,24cyclictest0-21swapper/111:09:381
2231399240,24cyclictest0-21swapper/109:24:161
2231399240,23cyclictest20362-21hddtemp_smartct11:46:221
2231399240,23cyclictest16188-21ssh10:10:131
2231399240,23cyclictest16188-21ssh10:10:131
2231399240,0cyclictest0-21swapper/110:07:391
22309992423,1cyclictest62550irq/127-eno112:00:220
2230999241,23cyclictest62550irq/127-eno110:18:560
2230999240,24cyclictest17591-21diskmemload12:29:170
2230999240,1cyclictest0-21swapper/011:56:200
2230999240,0cyclictest17591-21diskmemload09:33:210
22319992323,0cyclictest0-21swapper/311:51:563
22319992323,0cyclictest0-21swapper/310:55:583
22319992323,0cyclictest0-21swapper/309:14:193
22319992322,1cyclictest0-21swapper/311:59:193
22319992322,1cyclictest0-21swapper/310:37:093
22319992321,1cyclictest9658-21ssh12:37:373
22319992321,1cyclictest9658-21ssh12:37:373
22319992321,1cyclictest32346-21sh10:26:083
22319992321,1cyclictest17591-21diskmemload10:31:273
22319992321,1cyclictest0-21swapper/311:36:173
22319992321,1cyclictest0-21swapper/311:10:053
22319992321,1cyclictest0-21swapper/310:51:013
22319992321,1cyclictest0-21swapper/310:06:523
22319992321,1cyclictest0-21swapper/309:33:203
2231999230,23cyclictest0-21swapper/310:17:393
2231999230,23cyclictest0-21swapper/309:52:203
2231999230,23cyclictest0-21swapper/309:36:243
2231999230,23cyclictest0-21swapper/309:17:063
2231999230,22cyclictest7790-21ssh12:05:083
2231999230,22cyclictest25326-21sh11:20:583
2231999230,1cyclictest22937-21ssh09:45:523
2231999230,0cyclictest17591-21diskmemload10:13:193
2231999230,0cyclictest17591-21diskmemload10:13:193
2231999230,0cyclictest0-21swapper/309:55:043
22315992323,0cyclictest0-21swapper/211:56:282
22315992323,0cyclictest0-21swapper/211:41:552
22315992322,1cyclictest0-21swapper/210:01:112
22315992321,1cyclictest25315-21memory09:16:232
22315992321,1cyclictest15046-21grep12:11:252
22315992320,2cyclictest6583-21ssh11:02:102
22315992320,2cyclictest21520-21sh10:15:222
22315992320,2cyclictest1438-21ssh12:30:262
22315992320,2cyclictest10385-21ssh10:36:082
2231599230,2cyclictest7413-21ssh09:31:062
2231599230,2cyclictest27398-21latency_hist09:50:002
2231599230,2cyclictest15628-21ssh10:41:122
2231599230,23cyclictest0-21swapper/212:39:542
2231599230,23cyclictest0-21swapper/212:39:542
2231599230,23cyclictest0-21swapper/211:36:332
2231599230,23cyclictest0-21swapper/211:25:082
2231599230,23cyclictest0-21swapper/211:24:332
2231599230,23cyclictest0-21swapper/209:29:342
2231599230,22cyclictest418-21rm12:29:222
2231599230,22cyclictest29560-21apt-get09:21:192
2231599230,22cyclictest14709-21ssh09:36:402
2231599230,0cyclictest17591-21diskmemload11:07:152
2231599230,0cyclictest0-21swapper/210:27:572
22313992323,0cyclictest0-21swapper/112:36:211
22313992323,0cyclictest0-21swapper/112:36:211
22313992323,0cyclictest0-21swapper/112:06:211
22313992323,0cyclictest0-21swapper/111:56:041
22313992323,0cyclictest0-21swapper/110:53:121
22313992323,0cyclictest0-21swapper/109:36:491
22313992323,0cyclictest0-21swapper/107:26:181
22313992321,1cyclictest12808-21sh10:37:071
22313992321,1cyclictest0-21swapper/110:48:431
22313992320,2cyclictest28783-21sh12:25:161
22313992319,3cyclictest7599-21apt08:50:011
2231399230,2cyclictest4820-21sh10:30:341
2231399230,23cyclictest17591-21diskmemload10:15:031
2231399230,23cyclictest0-21swapper/111:40:461
2231399230,23cyclictest0-21swapper/111:22:301
2231399230,23cyclictest0-21swapper/110:20:551
2231399230,23cyclictest0-21swapper/109:27:261
2231399230,22cyclictest31798-21diskmemload09:53:561
2231399230,22cyclictest28558-21ssh11:54:201
2231399230,22cyclictest26998-21ssh09:49:291
2231399230,22cyclictest18955-21/usr/sbin/munin12:16:201
2231399230,22cyclictest1673-21sh11:28:081
2231399230,22cyclictest13056-21ssh12:10:161
2231399230,22cyclictest1048-21sh09:56:011
2231399230,1cyclictest2370-21ssh10:27:081
2231399230,0cyclictest17591-21diskmemload10:56:231
2231399230,0cyclictest0-21swapper/111:30:371
2231399230,0cyclictest0-21swapper/111:00:361
22309992323,0cyclictest32619-21ssh10:26:210
22309992323,0cyclictest17591-21diskmemload11:00:180
22309992323,0cyclictest0-21swapper/010:47:400
2230999232,21cyclictest7808-21kworker/0:210:50:130
22309992321,1cyclictest0-21swapper/009:40:030
22309992320,2cyclictest0-21swapper/010:05:490
2230999230,23cyclictest17591-21diskmemload10:43:370
2230999230,23cyclictest0-21swapper/011:14:450
2230999230,23cyclictest0-21swapper/010:13:410
2230999230,23cyclictest0-21swapper/010:13:410
2230999230,23cyclictest0-21swapper/009:51:010
2230999230,23cyclictest0-21swapper/009:29:200
2230999230,22cyclictest27632-21latency_hist08:25:000
2230999230,22cyclictest16131-21sh12:12:240
2230999230,22cyclictest12679-21sh12:10:010
2230999230,22cyclictest0-21swapper/012:30:160
2230999230,22cyclictest0-21swapper/011:46:230
2230999230,21cyclictest0-21swapper/010:20:340
2230999230,1cyclictest30365-21apt-get11:25:020
2230999230,1cyclictest20464-21sh11:16:200
2230999230,1cyclictest10966-21ssh10:36:190
2230999230,1cyclictest10400-21grep08:55:010
2230999230,1cyclictest0-21swapper/012:23:110
2230999230,1cyclictest0-21swapper/011:35:530
2230999230,0cyclictest17591-21diskmemload11:30:310
2230999230,0cyclictest17591-21diskmemload11:07:090
2230999230,0cyclictest0-21swapper/011:20:520
22319992222,0cyclictest0-21swapper/309:20:263
22319992221,1cyclictest0-21swapper/311:01:483
22319992220,2cyclictest19158-21ssh10:43:453
22319992220,1cyclictest24195-21apt-get12:21:203
22319992220,1cyclictest0-21swapper/311:26:203
22319992220,1cyclictest0-21swapper/308:50:013
2231999220,22cyclictest0-21swapper/311:15:353
2231999220,21cyclictest342-21cron08:35:013
2231999220,21cyclictest11407-21sh11:06:393
2231999220,21cyclictest0-21swapper/312:10:223
2231999220,1cyclictest7260-21if_enp1s0.810:01:213
2231999220,1cyclictest17455-21ssh11:43:193
2231999220,0cyclictest17591-21diskmemload10:24:263
22315992222,0cyclictest0-21swapper/211:10:362
22315992222,0cyclictest0-21swapper/209:55:472
22315992221,1cyclictest18845-21ssh09:10:592
2231599220,22cyclictest0-21swapper/212:15:292
2231599220,21cyclictest24111-21ssh12:21:142
2231599220,21cyclictest17591-21diskmemload12:05:202
2231599220,21cyclictest0-21swapper/207:46:172
2231599220,1cyclictest0-21swapper/210:20:112
22313992220,1cyclictest12762-21awk07:55:011
2231399220,22cyclictest0-21swapper/108:10:021
2231399220,21cyclictest7459-21ssh09:31:111
2231399220,21cyclictest30019-21apt-get08:30:021
2231399220,21cyclictest23585-21ssh12:20:171
2231399220,21cyclictest0-21swapper/109:15:081
2231399220,21cyclictest0-21swapper/107:56:181
2231399220,1cyclictest2968-21ssh12:00:491
2231399220,1cyclictest0-21swapper/111:10:561
2231399220,0cyclictest0-21swapper/109:11:181
2231399220,0cyclictest0-21swapper/108:51:201
22309992222,0cyclictest0-21swapper/009:10:250
22309992221,1cyclictest62550irq/127-eno109:35:260
22309992221,1cyclictest0-21swapper/011:41:080
22309992221,0cyclictest13117-21apt-get07:56:180
22309992220,1cyclictest896-21sh09:55:470
22309992220,1cyclictest6376-21sh12:35:100
22309992220,1cyclictest6376-21sh12:35:100
22309992220,1cyclictest30000-21diskstats09:21:210
22309992220,1cyclictest17591-21diskmemload12:15:170
22309992219,3cyclictest20008-21apt-get08:10:020
2230999221,1cyclictest62550irq/127-eno110:55:390
2230999220,21cyclictest17591-21diskmemload09:46:100
2230999220,21cyclictest0-21swapper/008:01:180
2230999220,21cyclictest0-21swapper/007:36:180
2230999220,1cyclictest0-21swapper/008:30:010
22319992121,0cyclictest0-21swapper/312:30:073
22319992119,1cyclictest2038-21sh09:25:563
2231999210,0cyclictest20772-21apt-get08:11:183
22315992121,0cyclictest0-21swapper/208:30:022
22315992119,1cyclictest7586-21munin-run07:45:012
2231599210,21cyclictest0-21swapper/208:36:192
2231599210,20cyclictest0-21swapper/208:16:172
2231599210,1cyclictest2588-21ssh12:00:172
2231599210,1cyclictest25027-21apt-get07:16:172
2231599210,1cyclictest24670-21cron07:15:012
2231599210,0cyclictest32272-21perf07:30:002
2231599210,0cyclictest0-21swapper/207:31:172
22313992120,0cyclictest23172-21apt-get08:16:181
22313992119,1cyclictest0-21swapper/107:25:001
2231399210,21cyclictest0-21swapper/108:10:001
2231399210,20cyclictest5536-21apt-get07:41:181
2231399210,20cyclictest15574-21apt-get09:06:201
22309992121,0cyclictest0-21swapper/009:15:440
2230999210,20cyclictest0-21swapper/008:41:170
2230999210,20cyclictest0-21swapper/008:31:160
22319992020,0cyclictest0-21swapper/307:50:023
22319992018,1cyclictest4769-21awk07:40:003
22319992018,1cyclictest12795-21dump-pmu-power09:00:003
2231999200,0cyclictest0-21swapper/308:21:193
2231999200,0cyclictest0-21swapper/307:21:193
22315992018,1cyclictest17571-21perf08:05:012
2231599200,19cyclictest0-21swapper/208:41:182
2231599200,0cyclictest27984-21apt-get08:26:182
2231599200,0cyclictest0-21swapper/209:06:202
2231399200,0cyclictest0-21swapper/108:36:201
2231399200,0cyclictest0-21swapper/107:16:171
22309992020,0cyclictest0-21swapper/008:56:190
22309992018,1cyclictest0-21swapper/007:25:020
22309992017,2cyclictest32636-21taskset07:31:170
2230999200,0cyclictest0-21swapper/007:40:020
22319991919,0cyclictest0-21swapper/307:41:183
22315991919,0cyclictest27449-21apt-get07:21:192
22315991919,0cyclictest0-21swapper/207:56:182
22309991917,1cyclictest0-21swapper/007:55:010
22319991818,0cyclictest0-21swapper/308:06:183
22319991818,0cyclictest0-21swapper/307:56:183
22319991817,0cyclictest7930-21apt-get07:46:173
22319991816,1cyclictest17632-21awk09:10:003
22315991818,0cyclictest17980-21apt-get08:06:172
22309991818,0cyclictest27449-21apt-get07:21:190
22309991818,0cyclictest0-21swapper/008:36:200
22309991818,0cyclictest0-21swapper/007:46:170
22309991817,1cyclictest22635-21apt-get07:11:190
22319991717,0cyclictest0-21swapper/308:51:203
22319991717,0cyclictest0-21swapper/308:26:183
22319991716,1cyclictest3179-21apt-get08:41:173
22319991716,0cyclictest15532-21apt-get08:01:183
22319991715,1cyclictest0-21swapper/307:15:013
2231999170,0cyclictest0-21swapper/307:31:173
22315991716,1cyclictest8367-21apt-get08:51:192
22313991717,0cyclictest0-21swapper/107:36:181
22313991716,1cyclictest10762-21apt-get08:56:191
22319991614,1cyclictest0-21swapper/308:16:233
2231599164,12cyclictest25593-21apt-get08:21:192
22313991616,0cyclictest13181-21apt-get09:01:191
22313991616,0cyclictest0-21swapper/108:21:191
22313991615,0cyclictest3179-21apt-get08:41:181
22313991614,1cyclictest0-21swapper/108:01:181
22309991616,0cyclictest0-21swapper/009:06:200
22309991616,0cyclictest0-21swapper/007:16:170
22319991515,0cyclictest0-21swapper/307:16:173
2231999150,1cyclictest0-21swapper/309:05:013
22315991514,1cyclictest0-21swapper/209:04:132
22315991510,5cyclictest2478-21munin-node08:56:432
22309991515,0cyclictest0-21swapper/008:46:180
2231999140,0cyclictest0-21swapper/308:36:043
2231999140,0cyclictest0-21swapper/307:25:123
2231599140,14cyclictest0-21swapper/208:45:092
2231599140,14cyclictest0-21swapper/207:50:142
2231599140,0cyclictest0-21swapper/208:11:062
2231599140,0cyclictest0-21swapper/207:35:452
22313991414,0cyclictest0-21swapper/107:30:271
2231399140,14cyclictest0-21swapper/108:25:301
22309991414,0cyclictest0-21swapper/009:00:210
22309991414,0cyclictest0-21swapper/008:05:060
2230999140,0cyclictest0-21swapper/008:15:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional