You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 20:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jun 24, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
572399280,0cyclictest0-21swapper/012:00:310
572399270,0cyclictest0-21swapper/009:35:430
5733992611,15cyclictest0-21swapper/312:17:123
5723992619,0cyclictest0-21swapper/008:45:310
572399260,21cyclictest27829-21ssh11:26:450
572399260,21cyclictest27829-21ssh11:26:450
572399260,1cyclictest25826-21ssh11:54:490
5733992523,2cyclictest0-21swapper/309:46:293
5733992523,1cyclictest607-21in:imuxsock07:25:003
5733992522,3cyclictest0-21swapper/309:10:103
5733992521,4cyclictest573-21diskmemload11:05:253
5733992521,3cyclictest0-21swapper/311:19:113
573399250,24cyclictest573-21diskmemload10:06:283
573399250,24cyclictest0-21swapper/311:13:183
573399250,1cyclictest31682-21ssh12:27:053
573399250,1cyclictest0-21swapper/309:28:203
573399250,0cyclictest0-21swapper/311:47:003
573399250,0cyclictest0-21swapper/310:54:433
5729992524,0cyclictest0-21swapper/209:31:162
572999250,24cyclictest0-21swapper/211:24:442
572999250,24cyclictest0-21swapper/211:06:332
572999250,24cyclictest0-21swapper/210:53:372
5725992523,1cyclictest0-21swapper/111:44:501
5723992521,4cyclictest62550irq/127-eno109:51:140
5723992521,0cyclictest0-21swapper/010:45:570
5723992520,1cyclictest1251-21ssh11:03:540
5723992520,0cyclictest25685-21ssh12:22:100
5723992520,0cyclictest0-21swapper/009:40:250
5723992519,1cyclictest12745-21ssh11:42:140
572399250,21cyclictest573-21diskmemload10:25:140
572399250,20cyclictest1231-21ssh10:05:430
572399250,0cyclictest8678-21ssh09:45:170
5733992421,3cyclictest0-21swapper/312:37:573
5733992420,3cyclictest0-21swapper/312:08:153
5733992420,3cyclictest0-21swapper/310:20:313
5733992419,4cyclictest4753-21ssh12:31:453
5733992419,4cyclictest24549-21awk11:25:003
573399240,23cyclictest4004-21ssh11:35:283
573399240,23cyclictest28642-21ssh11:27:573
573399240,23cyclictest28642-21ssh11:27:573
573399240,21cyclictest0-21swapper/312:03:573
573399240,21cyclictest0-21swapper/310:48:253
573399240,1cyclictest16837-21ssh09:23:563
573399240,1cyclictest0-21swapper/311:57:143
573399240,0cyclictest0-21swapper/310:42:203
573399240,0cyclictest0-21swapper/309:57:163
5729992422,1cyclictest783-21snmpd11:40:432
572999240,23cyclictest6977-21apt-get12:05:412
572999240,23cyclictest28219-21sendmail09:00:002
572999240,23cyclictest0-21swapper/210:42:162
572999240,1cyclictest2429-21ntpq09:10:362
5725992424,0cyclictest0-21swapper/112:37:351
5725992424,0cyclictest0-21swapper/110:49:551
5725992423,1cyclictest573-21diskmemload12:22:431
5725992423,1cyclictest0-21swapper/109:40:301
5725992422,1cyclictest0-21swapper/110:09:451
572599240,24cyclictest0-21swapper/109:23:061
572599240,23cyclictest75-21kswapd010:35:301
572599240,23cyclictest0-21swapper/112:19:401
572599240,1cyclictest573-21diskmemload11:46:221
572599240,0cyclictest573-21diskmemload12:07:311
572599240,0cyclictest573-21diskmemload11:16:261
5723992423,1cyclictest573-21diskmemload10:12:140
5723992422,1cyclictest21698-21diskmemload11:21:020
5723992420,0cyclictest0-21swapper/011:38:000
572399240,24cyclictest75-21kswapd011:30:300
572399240,24cyclictest0-21swapper/010:30:470
572399240,24cyclictest0-21swapper/009:14:590
572399240,23cyclictest15734-21rm10:19:360
572399240,23cyclictest0-21swapper/009:15:050
572399240,21cyclictest0-21swapper/012:16:110
572399240,1cyclictest28342-21ssh09:34:130
572399240,0cyclictest18146-21apt-get10:50:310
572399240,0cyclictest0-21swapper/012:33:350
572399240,0cyclictest0-21swapper/010:55:520
5733992323,0cyclictest0-21swapper/310:25:383
5733992321,2cyclictest0-21swapper/311:53:243
5733992321,1cyclictest24913-21/usr/sbin/munin10:55:353
5733992320,3cyclictest0-21swapper/312:10:123
5733992320,2cyclictest7236-21ssh10:11:093
5733992319,3cyclictest0-21swapper/311:00:403
573399230,2cyclictest11902-21ssh11:40:593
573399230,23cyclictest0-21swapper/310:34:073
573399230,23cyclictest0-21swapper/309:51:193
573399230,23cyclictest0-21swapper/309:35:523
573399230,22cyclictest0-21swapper/311:31:293
573399230,22cyclictest0-21swapper/309:31:373
573399230,20cyclictest0-21swapper/309:15:573
573399230,1cyclictest28269-21munin-run09:00:003
573399230,0cyclictest0-21swapper/312:21:383
5729992323,0cyclictest0-21swapper/212:16:052
5729992323,0cyclictest0-21swapper/212:00:082
5729992323,0cyclictest0-21swapper/210:24:162
5729992322,1cyclictest0-21swapper/211:48:502
5729992322,1cyclictest0-21swapper/211:00:442
5729992322,1cyclictest0-21swapper/210:27:282
5729992322,0cyclictest0-21swapper/210:12:422
5729992321,1cyclictest0-21swapper/210:09:492
572999230,2cyclictest27423-21perf07:55:012
572999230,23cyclictest0-21swapper/211:17:292
572999230,23cyclictest0-21swapper/210:30:132
572999230,23cyclictest0-21swapper/209:19:492
572999230,22cyclictest573-21diskmemload09:51:022
572999230,22cyclictest573-21diskmemload09:21:092
572999230,22cyclictest20541-21rm09:26:122
572999230,22cyclictest11326-21rm09:46:302
572999230,22cyclictest0-21swapper/212:38:422
572999230,22cyclictest0-21swapper/212:33:422
572999230,22cyclictest0-21swapper/211:57:422
572999230,0cyclictest0-21swapper/212:10:302
572999230,0cyclictest0-21swapper/211:27:292
572999230,0cyclictest0-21swapper/211:27:292
5725992323,0cyclictest573-21diskmemload11:51:401
5725992323,0cyclictest573-21diskmemload11:26:191
5725992323,0cyclictest573-21diskmemload11:26:191
5725992323,0cyclictest573-21diskmemload11:05:011
5725992323,0cyclictest0-21swapper/111:21:271
5725992323,0cyclictest0-21swapper/110:26:251
5725992323,0cyclictest0-21swapper/109:32:421
5725992322,1cyclictest0-21swapper/109:58:231
5725992321,1cyclictest13209-21apt-get07:25:291
5725992321,1cyclictest0-21swapper/110:40:301
5725992320,2cyclictest2772-21sh11:34:091
5725992320,2cyclictest22620-21sh07:45:011
5725992320,2cyclictest11403-21ssh11:12:321
5725992320,2cyclictest10490-21cron07:20:001
572599230,2cyclictest30244-21ssh10:31:081
572599230,23cyclictest0-21swapper/111:56:431
572599230,23cyclictest0-21swapper/110:22:111
572599230,22cyclictest606-21dbus-daemon08:40:011
572599230,22cyclictest573-21diskmemload10:53:201
572599230,22cyclictest4037-21ssh11:35:301
572599230,22cyclictest28712-21sh12:25:241
572599230,22cyclictest1782-21ssh12:00:541
572599230,22cyclictest0-21swapper/112:10:311
572599230,22cyclictest0-21swapper/110:19:301
572599230,0cyclictest0-21swapper/112:34:261
572599230,0cyclictest0-21swapper/110:57:061
572599230,0cyclictest0-21swapper/110:00:381
572599230,0cyclictest0-21swapper/109:51:241
5723992323,0cyclictest0-21swapper/011:14:470
5723992323,0cyclictest0-21swapper/010:20:010
5723992323,0cyclictest0-21swapper/010:04:150
5723992320,0cyclictest573-21diskmemload12:12:590
5723992320,0cyclictest0-21swapper/010:37:160
572399230,22cyclictest20404-21ssh09:26:020
572399230,22cyclictest20234-21sendmail-msp07:40:010
572399230,22cyclictest20080-21sh09:55:290
572399230,22cyclictest16617-21ssh11:45:370
572399230,22cyclictest0-21swapper/009:20:140
5733992221,1cyclictest1222-21apt-get10:35:313
5733992217,4cyclictest894-21apt-get08:05:323
5733992216,5cyclictest12675-21munin-run08:30:013
573399220,21cyclictest12961-21apt-get08:30:293
573399220,21cyclictest0-21swapper/307:45:013
573399220,1cyclictest25812-21apt-get10:00:303
5729992222,0cyclictest0-21swapper/210:00:032
5729992221,1cyclictest573-21diskmemload09:35:242
5729992221,0cyclictest0-21swapper/207:40:312
5729992220,1cyclictest22650-21apt-get08:50:022
5729992220,1cyclictest0-21swapper/212:20:022
572999220,21cyclictest573-21diskmemload10:35:442
572999220,21cyclictest3352-21apt-get08:10:312
572999220,21cyclictest2987-21sh08:10:002
572999220,21cyclictest0-21swapper/212:25:552
572999220,21cyclictest0-21swapper/211:50:342
572999220,21cyclictest0-21swapper/211:35:232
572999220,21cyclictest0-21swapper/211:10:422
572999220,21cyclictest0-21swapper/210:49:392
572999220,21cyclictest0-21swapper/209:40:022
572999220,1cyclictest0-21swapper/211:34:552
572999220,1cyclictest0-21swapper/209:55:482
572999220,0cyclictest0-21swapper/210:16:532
5725992222,0cyclictest0-21swapper/111:00:201
5725992222,0cyclictest0-21swapper/109:13:161
5725992220,1cyclictest0-21swapper/110:10:171
5725992220,1cyclictest0-21swapper/109:27:121
5725992219,2cyclictest28254-21apt09:00:001
572599220,21cyclictest5755-21apt-get08:15:311
572599220,21cyclictest0-21swapper/109:35:011
572599220,0cyclictest0-21swapper/109:45:371
5723992221,1cyclictest27715-21apt-get07:55:270
572399220,21cyclictest8797-21ssh10:40:480
572399220,21cyclictest0-21swapper/012:25:200
572399220,21cyclictest0-21swapper/011:55:420
572399220,1cyclictest8115-21munin-run07:15:000
572399220,1cyclictest10685-21ssh12:37:160
5733992119,2cyclictest0-21swapper/309:05:313
573399210,20cyclictest0-21swapper/308:10:303
5729992120,0cyclictest17774-21apt-get08:40:302
572999210,21cyclictest0-21swapper/208:45:312
572999210,20cyclictest22925-21apt-get07:45:292
572999210,20cyclictest0-21swapper/208:35:322
5725992120,1cyclictest15606-21apt-get07:30:291
572599210,21cyclictest0-21swapper/109:15:421
572599210,20cyclictest0-21swapper/107:45:291
572599210,0cyclictest19894-21apt-get08:45:021
5723992121,0cyclictest0-21swapper/008:25:320
5723992119,1cyclictest606-21dbus-daemon07:55:010
572399210,21cyclictest0-21swapper/008:00:020
572399210,20cyclictest0-21swapper/007:30:300
573399200,0cyclictest0-21swapper/308:40:303
5729992018,1cyclictest0-21swapper/209:10:002
5725992020,0cyclictest0-21swapper/108:00:311
572599200,20cyclictest0-21swapper/108:05:321
572599200,20cyclictest0-21swapper/107:20:301
572599200,1cyclictest19861-21basename08:45:011
5723992020,0cyclictest0-21swapper/009:05:310
5723992019,0cyclictest20526-21apt-get07:40:310
5723992017,2cyclictest19894-21apt08:45:010
572399200,0cyclictest0-21swapper/008:55:290
5733991919,0cyclictest0-21swapper/308:15:303
5733991913,5cyclictest8161-21munin-run07:15:003
573399190,18cyclictest0-21swapper/307:30:303
573399190,0cyclictest0-21swapper/308:00:013
5729991919,0cyclictest0-21swapper/208:15:312
5729991919,0cyclictest0-21swapper/207:25:292
572999190,17cyclictest8076-21cron07:15:002
5725991919,0cyclictest0-21swapper/109:05:311
5725991919,0cyclictest0-21swapper/107:10:311
5723991919,0cyclictest0-21swapper/008:05:320
5723991919,0cyclictest0-21swapper/007:15:300
5729991818,0cyclictest0-21swapper/208:30:302
5729991817,1cyclictest0-21swapper/208:00:022
5725991818,0cyclictest0-21swapper/107:55:281
5725991818,0cyclictest0-21swapper/107:50:291
5725991816,1cyclictest606-21dbus-daemon08:35:011
5723991818,0cyclictest0-21swapper/008:30:290
5733991717,0cyclictest0-21swapper/308:50:303
5733991715,1cyclictest619-21polkitd08:00:003
5729991717,0cyclictest0-21swapper/209:00:292
5729991715,1cyclictest29811-21apt-get08:00:002
5725991717,0cyclictest0-21swapper/108:50:011
5725991717,0cyclictest0-21swapper/108:20:291
5723991717,0cyclictest8173-21apt-get08:20:300
5723991717,0cyclictest12929-21munin-run07:25:000
5723991717,0cyclictest0-21swapper/007:25:290
5733991616,0cyclictest0-21swapper/307:45:303
5733991610,5cyclictest0-21swapper/308:35:323
573399160,0cyclictest0-21swapper/307:39:583
5729991615,1cyclictest21950irq/142-nvme0q307:40:012
5729991614,1cyclictest12914-21latency_hist07:25:002
5723991616,0cyclictest0-21swapper/009:00:290
5723991614,1cyclictest606-21dbus-daemon08:20:000
5723991611,4cyclictest16986-21unixbench_multi08:35:410
572399160,15cyclictest25450-21apt-get08:55:000
5733991513,1cyclictest9550-21sensors08:20:373
5733991513,1cyclictest25319-21apt-get07:50:293
573399149,5cyclictest0-21swapper/308:45:313
5733991414,0cyclictest0-21swapper/307:15:293
573399140,14cyclictest0-21swapper/309:00:213
573399140,14cyclictest0-21swapper/307:25:343
5729991414,0cyclictest8395-21apt-get07:15:302
5729991414,0cyclictest0-21swapper/208:25:362
572999140,0cyclictest8173-21apt-get08:20:302
572999140,0cyclictest0-21swapper/207:31:092
5725991414,0cyclictest0-21swapper/108:25:451
572599140,7cyclictest0-21swapper/107:35:331
572599140,14cyclictest0-21swapper/108:10:371
5723991412,1cyclictest22925-21apt-get07:45:300
572399140,14cyclictest0-21swapper/008:10:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional