You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 20:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Sep 05, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16058992524,1cyclictest0-21swapper/310:38:573
16058992523,1cyclictest0-21swapper/310:59:283
1605899250,24cyclictest28877-21ssh10:54:123
1605899250,24cyclictest0-21swapper/311:16:073
1605899250,1cyclictest0-21swapper/312:11:233
1605899250,1cyclictest0-21swapper/308:00:003
1605799250,24cyclictest17794-21apt-get08:21:302
16056992523,1cyclictest606-21dbus-daemon12:20:001
1605699250,24cyclictest0-21swapper/111:02:561
1605599250,24cyclictest24191-21munin-run10:50:010
16058992423,1cyclictest9438-21diskmemload11:56:373
16058992422,1cyclictest0-21swapper/312:20:533
16058992422,1cyclictest0-21swapper/309:13:453
1605899240,24cyclictest9438-21diskmemload11:09:463
1605899240,1cyclictest9438-21diskmemload09:48:433
1605899240,0cyclictest9438-21diskmemload10:30:473
16057992422,2cyclictest0-21swapper/209:40:222
16057992421,2cyclictest12737-21ssh10:10:172
1605799240,23cyclictest9438-21diskmemload11:50:262
1605799240,23cyclictest500-21ssh09:58:572
1605799240,23cyclictest0-21swapper/212:23:502
1605799240,23cyclictest0-21swapper/210:54:012
1605699240,1cyclictest0-21swapper/110:31:301
1605699240,0cyclictest0-21swapper/112:14:441
1605599242,1cyclictest62550irq/127-eno109:41:160
1605599240,24cyclictest0-21swapper/010:36:160
1605599240,23cyclictest9438-21diskmemload10:17:130
1605599240,1cyclictest10011-21ssh11:35:480
1605599240,0cyclictest9438-21diskmemload11:12:530
16058992323,0cyclictest0-21swapper/311:47:543
16058992323,0cyclictest0-21swapper/311:35:063
16058992323,0cyclictest0-21swapper/311:25:283
16058992323,0cyclictest0-21swapper/310:26:273
16058992323,0cyclictest0-21swapper/310:16:323
16058992323,0cyclictest0-21swapper/309:39:463
16058992323,0cyclictest0-21swapper/309:21:053
16058992321,2cyclictest14294-21ssh11:10:063
16058992321,1cyclictest0-21swapper/312:18:223
1605899230,2cyclictest7627-21ssh12:01:433
1605899230,2cyclictest5946-21awk09:35:003
1605899230,23cyclictest0-21swapper/312:06:473
1605899230,22cyclictest7179-21sh10:05:143
1605899230,22cyclictest0-21swapper/312:25:253
1605899230,22cyclictest0-21swapper/311:41:483
1605899230,0cyclictest9438-21diskmemload12:30:093
1605899230,0cyclictest0-21swapper/310:22:293
1605899230,0cyclictest0-21swapper/310:10:573
1605899230,0cyclictest0-21swapper/309:16:103
16057992323,0cyclictest0-21swapper/211:32:462
16057992323,0cyclictest0-21swapper/211:32:462
16057992322,1cyclictest9438-21diskmemload10:30:102
16057992321,1cyclictest0-21swapper/212:19:192
16057992321,1cyclictest0-21swapper/211:07:142
16057992320,2cyclictest5179-21ssh12:00:492
16057992320,0cyclictest0-21swapper/212:38:442
16057992320,0cyclictest0-21swapper/209:30:092
1605799230,23cyclictest9438-21diskmemload09:13:192
1605799230,23cyclictest0-21swapper/211:49:292
1605799230,23cyclictest0-21swapper/211:11:312
1605799230,23cyclictest0-21swapper/210:46:302
1605799230,22cyclictest4225-21/usr/sbin/munin11:01:342
1605799230,22cyclictest26991-21idleruntime-cro08:40:002
1605799230,22cyclictest23798-21diskmemload10:20:292
1605799230,22cyclictest20270-21latency_hist11:45:012
1605799230,22cyclictest19796-21sh09:17:322
1605799230,22cyclictest0-21swapper/212:10:482
1605799230,22cyclictest0-21swapper/209:48:572
1605799230,0cyclictest9438-21diskmemload12:33:342
1605799230,0cyclictest0-21swapper/212:07:562
1605799230,0cyclictest0-21swapper/209:53:562
16056992323,0cyclictest9438-21diskmemload12:34:471
16056992323,0cyclictest0-21swapper/111:27:551
16056992323,0cyclictest0-21swapper/111:20:491
16056992323,0cyclictest0-21swapper/110:07:181
16056992323,0cyclictest0-21swapper/109:42:371
16056992323,0cyclictest0-21swapper/109:32:011
16056992323,0cyclictest0-21swapper/109:27:271
16056992321,1cyclictest313-21systemd-journal09:25:011
16056992321,1cyclictest24614-21perf08:35:011
16056992321,1cyclictest19801-21awk08:25:011
16056992321,1cyclictest0-21swapper/111:51:341
16056992320,2cyclictest31130-21sh09:56:451
1605699230,23cyclictest0-21swapper/111:07:571
1605699230,23cyclictest0-21swapper/110:02:151
1605699230,22cyclictest9438-21diskmemload11:30:371
1605699230,22cyclictest9438-21diskmemload11:30:371
1605699230,22cyclictest24839-21ssh11:48:411
1605699230,22cyclictest20658-21sh09:47:201
1605699230,22cyclictest17493-21ssh11:12:191
1605699230,0cyclictest9438-21diskmemload10:54:231
1605699230,0cyclictest0-21swapper/110:47:501
16055992323,0cyclictest0-21swapper/012:28:230
16055992323,0cyclictest0-21swapper/012:05:160
16055992323,0cyclictest0-21swapper/012:04:430
16055992323,0cyclictest0-21swapper/011:56:580
16055992323,0cyclictest0-21swapper/010:51:490
16055992323,0cyclictest0-21swapper/009:20:120
16055992322,1cyclictest23052-21ssh11:17:250
16055992321,1cyclictest0-21swapper/012:36:440
16055992320,2cyclictest10051-21sh09:10:280
1605599230,22cyclictest6375-21ssh12:31:150
1605599230,22cyclictest6258-21rm10:33:250
1605599230,22cyclictest28600-21ssh11:22:190
1605599230,22cyclictest16362-21rm09:15:130
1605599230,22cyclictest12306-21perf10:10:010
1605599230,1cyclictest13470-21rm10:40:250
1605599230,1cyclictest13470-21rm10:40:250
1605599230,0cyclictest0-21swapper/011:47:220
1605599230,0cyclictest0-21swapper/011:41:330
1605599230,0cyclictest0-21swapper/010:10:540
1605599230,0cyclictest0-21swapper/009:25:140
16058992222,0cyclictest0-21swapper/311:00:453
16058992222,0cyclictest0-21swapper/310:02:313
16058992222,0cyclictest0-21swapper/309:51:583
16058992220,1cyclictest0-21swapper/307:30:013
1605899220,21cyclictest30572-21cron07:40:013
1605899220,21cyclictest0-21swapper/311:31:303
1605899220,21cyclictest0-21swapper/311:31:303
1605899220,21cyclictest0-21swapper/311:21:593
1605899220,21cyclictest0-21swapper/309:40:133
1605899220,21cyclictest0-21swapper/309:25:403
1605899220,21cyclictest0-21swapper/308:50:003
1605899220,21cyclictest0-21swapper/308:41:333
1605899220,21cyclictest0-21swapper/307:20:003
1605899220,1cyclictest0-21swapper/312:35:253
1605899220,0cyclictest0-21swapper/310:40:113
1605899220,0cyclictest0-21swapper/310:40:113
16057992222,0cyclictest10447-21ssh11:36:332
16057992222,0cyclictest0-21swapper/210:56:072
16057992220,1cyclictest0-21swapper/211:58:242
16057992220,1cyclictest0-21swapper/210:35:332
16057992219,0cyclictest0-21swapper/211:27:312
1605799220,22cyclictest16900-21ssh10:42:522
1605799220,22cyclictest16900-21ssh10:42:522
1605799220,22cyclictest0-21swapper/211:20:242
1605799220,21cyclictest27774-21sh09:25:282
1605799220,21cyclictest0-21swapper/212:25:032
1605799220,21cyclictest0-21swapper/210:25:282
1605799220,21cyclictest0-21swapper/209:35:172
1605799220,21cyclictest0-21swapper/209:21:102
1605799220,1cyclictest0-21swapper/210:05:112
1605799220,1cyclictest0-21swapper/210:00:222
16056992222,0cyclictest9438-21diskmemload10:13:031
16056992222,0cyclictest0-21swapper/111:17:081
16056992222,0cyclictest0-21swapper/110:56:141
16056992222,0cyclictest0-21swapper/110:36:591
16056992222,0cyclictest0-21swapper/110:21:091
16056992222,0cyclictest0-21swapper/110:15:341
16056992220,2cyclictest10566-21ssh12:05:381
16056992220,1cyclictest7068-21apt09:05:001
16056992220,1cyclictest16661-21sh09:15:341
16056992219,2cyclictest15204-21rm11:40:191
1605699220,22cyclictest9438-21diskmemload12:01:381
1605699220,22cyclictest30245-21ssh12:22:331
1605699220,22cyclictest0-21swapper/109:38:381
1605699220,21cyclictest29734-21ssh10:25:561
1605699220,21cyclictest26115-21ssh09:52:111
1605699220,21cyclictest13477-21ssh10:40:251
1605699220,21cyclictest13477-21ssh10:40:251
1605699220,21cyclictest12974-21apt-get08:11:321
1605699220,21cyclictest0-21swapper/111:56:051
1605699220,1cyclictest0-21swapper/112:25:141
1605699220,0cyclictest0-21swapper/109:10:351
16055992222,0cyclictest0-21swapper/010:25:310
16055992222,0cyclictest0-21swapper/010:03:060
16055992220,1cyclictest19297-21ssh12:12:460
16055992220,1cyclictest14984-21sh08:15:000
16055992220,1cyclictest0-21swapper/009:36:370
1605599220,22cyclictest0-21swapper/011:52:540
1605599220,21cyclictest9438-21diskmemload12:20:050
1605599220,21cyclictest20859-21lockfile-create07:20:000
1605599220,21cyclictest0-21swapper/011:00:570
1605599220,21cyclictest0-21swapper/010:55:160
1605599220,1cyclictest62550irq/127-eno109:33:300
1605599220,1cyclictest2673-21ssh11:28:420
1605599220,1cyclictest21235-21ssh09:48:040
1605599220,1cyclictest16419-21apt-get07:11:330
16058992120,0cyclictest0-21swapper/309:10:013
16058992120,0cyclictest0-21swapper/309:10:013
16058992119,1cyclictest0-21swapper/311:51:043
1605899210,20cyclictest0-21swapper/307:46:333
1605899210,0cyclictest0-21swapper/310:45:073
1605899210,0cyclictest0-21swapper/308:01:323
16057992120,1cyclictest0-21swapper/211:15:082
16057992120,0cyclictest0-21swapper/207:26:302
1605799210,21cyclictest0-21swapper/210:15:392
16056992121,0cyclictest23624-21apt-get07:26:301
1605699210,21cyclictest9552-21ssh11:35:131
1605699210,21cyclictest0-21swapper/112:35:051
1605699210,21cyclictest0-21swapper/107:36:321
1605699210,0cyclictest0-21swapper/107:16:321
16055992121,0cyclictest0-21swapper/009:56:360
16055992120,1cyclictest62550irq/127-eno111:30:020
16055992120,1cyclictest62550irq/127-eno111:30:020
1605599210,21cyclictest0-21swapper/011:05:460
16058992020,0cyclictest0-21swapper/308:21:293
16058992020,0cyclictest0-21swapper/307:21:303
16058992019,0cyclictest0-21swapper/308:11:323
16058992019,0cyclictest0-21swapper/307:11:333
1605899200,0cyclictest0-21swapper/308:31:333
16057992020,0cyclictest0-21swapper/208:40:022
16057992020,0cyclictest0-21swapper/207:16:322
16057992019,1cyclictest32638-21apt-get08:51:312
16057992019,1cyclictest22590-21apt-get08:31:332
16057992019,0cyclictest0-21swapper/207:21:312
16056992020,0cyclictest8186-21apt-get08:01:321
16056992020,0cyclictest27799-21apt-get08:41:321
16056992020,0cyclictest26026-21apt-get07:31:331
16056992020,0cyclictest0-21swapper/108:06:321
16055992020,0cyclictest0-21swapper/007:46:330
16055992018,1cyclictest5408-21perf07:55:000
1605599200,0cyclictest0-21swapper/008:41:330
16058991918,1cyclictest0-21swapper/307:41:313
16057991919,0cyclictest0-21swapper/207:51:322
16057991918,0cyclictest16419-21apt-get07:11:322
16056991919,0cyclictest20191-21apt-get08:26:321
16056991919,0cyclictest0-21swapper/108:36:331
16055991919,0cyclictest0-21swapper/007:31:330
16055991917,1cyclictest5041-21apt-get09:01:310
16058991818,0cyclictest0-21swapper/308:16:313
16058991818,0cyclictest0-21swapper/307:31:333
16057991818,0cyclictest0-21swapper/209:06:332
16057991818,0cyclictest0-21swapper/209:06:332
16056991818,0cyclictest0-21swapper/109:06:331
16056991818,0cyclictest0-21swapper/109:06:331
16055991818,0cyclictest0-21swapper/008:26:320
16055991818,0cyclictest0-21swapper/007:36:320
16055991817,1cyclictest7438-21apt-get09:06:330
16055991817,1cyclictest7438-21apt-get09:06:330
16055991817,1cyclictest24988-21apt-get08:36:330
16055991816,1cyclictest2239-21awk08:55:000
16057991717,0cyclictest0-21swapper/208:26:322
16057991717,0cyclictest0-21swapper/207:45:352
16057991716,0cyclictest10580-21apt-get08:06:322
16056991717,0cyclictest2626-21apt-get08:56:321
1605599171,8cyclictest23623-21apt07:26:300
16055991717,0cyclictest0-21swapper/008:56:330
16055991717,0cyclictest0-21swapper/008:16:310
16055991715,1cyclictest7826-21awk08:00:000
16058991616,0cyclictest0-21swapper/307:51:323
16056991616,0cyclictest0-21swapper/107:56:301
16056991616,0cyclictest0-21swapper/107:46:331
16056991616,0cyclictest0-21swapper/107:11:331
16055991616,0cyclictest0-21swapper/008:21:290
16055991614,1cyclictest23258-21grep07:25:000
1605599160,15cyclictest0-21swapper/008:01:320
1605899150,14cyclictest728-21perl08:51:333
16057991515,0cyclictest0-21swapper/208:56:332
16057991515,0cyclictest0-21swapper/207:31:332
1605599150,1cyclictest31951-21awk08:46:410
1605599150,1cyclictest0-21swapper/008:31:370
16058991414,0cyclictest0-21swapper/308:27:203
1605899140,14cyclictest0-21swapper/309:02:383
1605899140,14cyclictest0-21swapper/308:55:153
16057991414,0cyclictest0-21swapper/208:15:482
1605799140,14cyclictest0-21swapper/208:10:362
1605799140,14cyclictest0-21swapper/208:00:262
1605799140,14cyclictest0-21swapper/207:55:132
1605799140,14cyclictest0-21swapper/207:40:052
1605799140,14cyclictest0-21swapper/207:36:182
1605799140,0cyclictest0-21swapper/208:45:392
16056991414,0cyclictest0-21swapper/107:50:181
1605699140,14cyclictest0-21swapper/108:45:231
1605699140,14cyclictest0-21swapper/108:15:181
1605699140,14cyclictest0-21swapper/107:40:031
1605699140,14cyclictest0-21swapper/107:20:041
1605599140,14cyclictest0-21swapper/008:05:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional