You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 21:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Tue Mar 24, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4093992621,4cyclictest0-21swapper/011:22:550
409699250,24cyclictest31090-21diskmemload10:16:323
409599250,24cyclictest0-21swapper/210:49:092
409599250,1cyclictest11273-21users09:52:592
409499250,2cyclictest11469-21awk08:30:001
409499250,24cyclictest0-21swapper/109:20:021
409399250,24cyclictest0-21swapper/009:56:580
409699240,24cyclictest31090-21diskmemload12:21:363
409699240,23cyclictest27675-21ssh10:42:323
409699240,1cyclictest31090-21diskmemload09:49:563
409699240,0cyclictest0-21swapper/311:50:103
4095992423,0cyclictest0-21swapper/209:12:122
4095992422,1cyclictest18360-21munin-run12:40:002
409599240,23cyclictest31090-21diskmemload11:32:252
409599240,23cyclictest31090-21diskmemload10:44:422
409599240,23cyclictest18470-21diskmemload10:01:052
409599240,23cyclictest0-21swapper/211:19:112
409599240,23cyclictest0-21swapper/210:27:322
409599240,23cyclictest0-21swapper/210:19:562
4094992422,2cyclictest23315-21ssh11:41:251
4094992422,1cyclictest0-21swapper/112:37:241
409499240,24cyclictest31090-21diskmemload10:35:331
409499240,1cyclictest0-21swapper/109:41:131
409499240,0cyclictest0-21swapper/111:53:111
4093992423,1cyclictest31090-21diskmemload09:19:220
409399240,24cyclictest31090-21diskmemload10:10:300
409399240,23cyclictest31235-21apt-get09:42:500
409399240,22cyclictest17612-21rm11:03:110
4096992323,0cyclictest31090-21diskmemload10:37:273
4096992323,0cyclictest0-21swapper/310:10:413
4096992320,2cyclictest15000-21rm11:01:443
409699230,2cyclictest21443-21sh08:50:013
409699230,23cyclictest0-21swapper/312:17:403
409699230,23cyclictest0-21swapper/311:35:433
409699230,23cyclictest0-21swapper/311:32:363
409699230,23cyclictest0-21swapper/310:01:093
409699230,23cyclictest0-21swapper/309:20:593
409699230,23cyclictest0-21swapper/309:17:173
409699230,22cyclictest6980-21sh11:25:103
409699230,22cyclictest31090-21diskmemload10:58:153
409699230,22cyclictest29535-21sh09:40:013
409699230,22cyclictest24341-21apt-get11:42:483
409699230,22cyclictest23758-21sh10:06:233
409699230,22cyclictest14095-21ssh09:57:153
409699230,0cyclictest31090-21diskmemload09:34:173
409699230,0cyclictest0-21swapper/311:47:323
409699230,0cyclictest0-21swapper/311:11:583
409699230,0cyclictest0-21swapper/310:51:283
409699230,0cyclictest0-21swapper/309:51:513
4095992323,0cyclictest0-21swapper/212:14:512
4095992323,0cyclictest0-21swapper/211:22:322
4095992323,0cyclictest0-21swapper/209:43:592
4095992321,1cyclictest605-21avahi-daemon11:15:012
4095992321,1cyclictest16258-21apt-get08:40:022
4095992321,1cyclictest0-21swapper/209:37:152
4095992321,1cyclictest0-21swapper/209:37:152
4095992321,1cyclictest0-21swapper/209:20:032
409599230,23cyclictest31090-21diskmemload09:46:082
409599230,23cyclictest0-21swapper/210:53:202
409599230,23cyclictest0-21swapper/210:32:042
409599230,22cyclictest9833-21sh12:32:152
409599230,22cyclictest31090-21diskmemload12:20:002
409599230,22cyclictest0-21swapper/211:59:582
409599230,22cyclictest0-21swapper/211:27:352
409599230,0cyclictest31090-21diskmemload11:45:432
409599230,0cyclictest0-21swapper/212:28:152
409599230,0cyclictest0-21swapper/212:06:002
409599230,0cyclictest0-21swapper/212:01:092
4094992323,0cyclictest31090-21diskmemload11:16:131
4094992323,0cyclictest0-21swapper/111:48:091
4094992323,0cyclictest0-21swapper/111:20:491
4094992323,0cyclictest0-21swapper/111:03:341
4094992323,0cyclictest0-21swapper/108:37:481
4094992321,1cyclictest0-21swapper/110:17:561
4094992321,1cyclictest0-21swapper/109:50:151
4094992321,1cyclictest0-21swapper/109:37:151
4094992321,1cyclictest0-21swapper/109:37:151
409499230,23cyclictest0-21swapper/110:45:431
409499230,23cyclictest0-21swapper/110:11:481
409499230,23cyclictest0-21swapper/109:57:421
409499230,22cyclictest19038-21perf09:30:001
409499230,22cyclictest1825-21cron08:10:011
409499230,22cyclictest0-21swapper/111:57:331
409499230,22cyclictest0-21swapper/110:30:101
409499230,22cyclictest0-21swapper/109:17:521
4093992323,0cyclictest357-21ssh11:18:040
4093992323,0cyclictest0-21swapper/012:10:270
4093992323,0cyclictest0-21swapper/012:04:090
4093992323,0cyclictest0-21swapper/011:50:570
4093992322,1cyclictest0-21swapper/009:21:060
409399230,2cyclictest22993-21rm11:40:490
409399230,23cyclictest4151-21sh10:50:360
409399230,23cyclictest0-21swapper/011:58:390
409399230,23cyclictest0-21swapper/011:46:320
409399230,23cyclictest0-21swapper/010:56:290
409399230,23cyclictest0-21swapper/009:26:070
409399230,22cyclictest8571-21sh12:30:130
409399230,22cyclictest348-21diskmemload10:47:410
409399230,0cyclictest31090-21diskmemload09:45:120
409399230,0cyclictest17437-21ssh12:38:300
409399230,0cyclictest0-21swapper/011:05:390
409399230,0cyclictest0-21swapper/010:23:460
4096992222,0cyclictest0-21swapper/312:28:333
4096992222,0cyclictest0-21swapper/310:31:573
4096992222,0cyclictest0-21swapper/308:27:503
4096992221,1cyclictest25192-21ssh09:36:163
4096992221,1cyclictest25192-21ssh09:36:163
4096992221,1cyclictest10244-21apt-get12:32:503
4096992220,1cyclictest31090-21diskmemload11:55:593
4096992219,2cyclictest605-21avahi-daemon08:15:013
409699221,21cyclictest0-21swapper/309:11:573
409699220,2cyclictest13979-21ptp4l10:27:573
409699220,22cyclictest15909-21ssh09:27:423
409699220,21cyclictest6637-21systemctl08:20:003
409699220,21cyclictest29425-21ssh11:15:253
409699220,21cyclictest20901-21ssh12:10:313
409699220,21cyclictest0-21swapper/312:05:353
409699220,21cyclictest0-21swapper/311:20:463
409699220,1cyclictest24375-21apt-get08:57:503
4095992222,0cyclictest31090-21diskmemload10:08:062
4095992222,0cyclictest31090-21diskmemload09:15:212
4095992222,0cyclictest0-21swapper/210:37:432
4095992220,1cyclictest0-21swapper/211:50:012
4095992220,1cyclictest0-21swapper/210:21:042
409599220,21cyclictest31090-21diskmemload12:20:482
409599220,21cyclictest31090-21diskmemload10:10:052
409599220,21cyclictest25075-21apt-get07:52:502
409599220,21cyclictest19520-21rm09:30:242
409599220,21cyclictest19166-21rm11:05:202
409599220,21cyclictest0-21swapper/210:55:412
409599220,21cyclictest0-21swapper/209:56:232
409599220,21cyclictest0-21swapper/209:25:232
409599220,21cyclictest0-21swapper/209:05:012
409599220,21cyclictest0-21swapper/207:40:002
409599220,1cyclictest13938-21ssh11:00:012
409599220,1cyclictest0-21swapper/211:42:102
4094992221,1cyclictest27521-21apt-get07:57:501
4094992221,1cyclictest1033-1kworker/u9:010:25:211
4094992221,1cyclictest0-21swapper/112:13:281
4094992221,1cyclictest0-21swapper/110:21:311
4094992220,1cyclictest0-21swapper/110:55:281
4094992220,1cyclictest0-21swapper/109:30:381
409499220,22cyclictest0-21swapper/112:25:561
409499220,22cyclictest0-21swapper/111:38:551
409499220,22cyclictest0-21swapper/111:06:431
409499220,22cyclictest0-21swapper/110:06:051
409499220,21cyclictest31090-21diskmemload12:05:341
409499220,21cyclictest24343-21sh11:10:231
409499220,21cyclictest0-21swapper/111:31:301
409499220,21cyclictest0-21swapper/111:25:281
409499220,21cyclictest0-21swapper/110:00:241
409499220,21cyclictest0-21swapper/109:10:241
409499220,21cyclictest0-21swapper/108:52:511
409499220,21cyclictest0-21swapper/108:42:501
409499220,1cyclictest4247-21dump-pmu-power08:15:011
409499220,1cyclictest32099-21ssh12:22:161
409499220,1cyclictest27010-21sh10:41:311
409499220,1cyclictest10673-21df12:32:511
409499220,1cyclictest0-21swapper/110:51:091
409499220,0cyclictest0-21swapper/112:18:481
4093992222,0cyclictest31090-21diskmemload09:50:260
4093992222,0cyclictest0-21swapper/009:11:070
4093992221,1cyclictest21884-21sh10:36:310
4093992221,1cyclictest2145-21ssh10:17:240
409399220,2cyclictest12147-21ssh11:30:240
409399220,22cyclictest0-21swapper/012:18:400
409399220,22cyclictest0-21swapper/011:10:500
409399220,21cyclictest6946-21ssh11:25:060
409399220,21cyclictest606-21dbus-daemon07:55:010
409399220,21cyclictest31090-21diskmemload10:32:090
409399220,21cyclictest26207-21sh10:40:100
409399220,21cyclictest0-21swapper/010:05:120
409399220,21cyclictest0-21swapper/008:17:510
409399220,1cyclictest24587-21sh07:50:000
409399220,1cyclictest21346-21ssh11:38:360
409399220,1cyclictest20033-21ssh09:31:090
409399220,0cyclictest10920-21ssh10:25:120
409399220,0cyclictest0-21swapper/012:06:460
409399220,0cyclictest0-21swapper/010:00:260
4096992121,0cyclictest31090-21diskmemload10:21:063
4096992121,0cyclictest0-21swapper/309:07:503
4096992120,1cyclictest32334-21apt-get08:07:523
4096992120,1cyclictest0-21swapper/310:46:493
4096992119,1cyclictest11256-21awk07:25:013
409699210,21cyclictest0-21swapper/311:05:173
409699210,20cyclictest0-21swapper/308:02:503
409699210,20cyclictest0-21swapper/307:42:493
409699210,0cyclictest31090-21diskmemload12:36:023
409699210,0cyclictest0-21swapper/312:00:063
4095992119,1cyclictest16827-21cron07:35:002
409599210,20cyclictest0-21swapper/208:17:512
409599210,0cyclictest29939-21apt-get08:02:502
4094992120,1cyclictest20232-21apt-get07:42:491
4094992120,1cyclictest14929-21apt-get07:32:491
4094992119,1cyclictest0-21swapper/107:17:491
409499210,0cyclictest0-21swapper/108:17:511
4093992121,0cyclictest0-21swapper/009:35:260
4093992121,0cyclictest0-21swapper/009:35:260
4093992121,0cyclictest0-21swapper/009:02:510
4093992121,0cyclictest0-21swapper/008:57:490
4093992121,0cyclictest0-21swapper/008:42:500
4093992120,0cyclictest0-21swapper/007:42:490
409399210,21cyclictest0-21swapper/012:20:380
409399210,20cyclictest0-21swapper/009:10:000
409399210,1cyclictest14073-21munin-run07:30:010
409399210,1cyclictest14060-21apt-get07:30:020
4096992020,0cyclictest17138-21apt-get08:42:503
4096992020,0cyclictest0-21swapper/308:32:493
4096992020,0cyclictest0-21swapper/307:47:503
4096992020,0cyclictest0-21swapper/307:27:483
4096992019,0cyclictest0-21swapper/308:37:493
409699200,0cyclictest0-21swapper/307:57:493
4095992020,0cyclictest9353-21apt-get07:22:492
4095992020,0cyclictest2316-21apt-get08:12:502
4095992020,0cyclictest0-21swapper/209:07:502
4095992020,0cyclictest0-21swapper/207:42:492
409599200,20cyclictest0-21swapper/207:25:022
409599200,0cyclictest0-21swapper/207:17:492
4094992020,0cyclictest0-21swapper/109:02:511
4094992020,0cyclictest0-21swapper/108:57:491
4094992020,0cyclictest0-21swapper/107:37:491
4094992019,0cyclictest0-21swapper/108:22:471
4093992020,0cyclictest0-21swapper/008:35:000
4093992020,0cyclictest0-21swapper/008:02:500
4095991919,0cyclictest0-21swapper/208:27:502
4095991918,0cyclictest0-21swapper/208:07:522
4094991919,0cyclictest0-21swapper/108:35:001
4094991918,0cyclictest0-21swapper/107:27:491
4096991818,0cyclictest0-21swapper/308:22:473
4095991818,0cyclictest22626-21apt-get07:47:502
4095991818,0cyclictest0-21swapper/208:52:512
4095991816,1cyclictest606-21dbus-daemon08:25:002
4094991818,0cyclictest0-21swapper/108:02:501
4094991815,2cyclictest27043-21perf07:55:011
4093991818,0cyclictest0-21swapper/007:12:490
4096991717,0cyclictest0-21swapper/307:32:503
4096991717,0cyclictest0-21swapper/307:12:493
4095991716,1cyclictest11930-21apt-get08:32:492
409599170,16cyclictest29465-21perf08:00:012
4093991717,0cyclictest7135-21apt-get08:22:470
4094991616,0cyclictest0-21swapper/107:47:501
4094991614,1cyclictest313-21systemd-journal07:15:011
409499160,15cyclictest21427-21cron08:50:011
4093991616,0cyclictest0-21swapper/008:47:500
4093991615,1cyclictest783-21snmpd08:08:390
409399160,15cyclictest18456-21hddtemp_smartct07:37:510
4096991515,0cyclictest0-21swapper/307:40:003
4095991513,1cyclictest0-21swapper/207:15:012
409599150,14cyclictest0-21swapper/208:37:592
4093991515,0cyclictest0-21swapper/008:52:500
4093991514,1cyclictest6934-21apt-get07:17:490
409399150,1cyclictest9782-21cstates08:27:510
409399150,15cyclictest0-21swapper/008:37:510
409699140,14cyclictest0-21swapper/309:01:493
409699140,0cyclictest0-21swapper/308:50:073
409699140,0cyclictest0-21swapper/307:51:123
409699140,0cyclictest0-21swapper/307:15:163
409599140,14cyclictest0-21swapper/208:56:082
409599140,14cyclictest0-21swapper/208:46:102
4093991414,0cyclictest0-21swapper/007:20:190
409399140,14cyclictest0-21swapper/008:10:100
409399140,0cyclictest0-21swapper/007:55:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional