You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 23:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 13, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32523992621,4cyclictest0-21swapper/209:51:322
3251699260,25cyclictest25864-21diskmemload10:28:070
3252699250,24cyclictest31389-21diskmemload12:35:433
3252699250,24cyclictest0-21swapper/312:28:113
32523992520,4cyclictest0-21swapper/209:11:512
3252399250,24cyclictest25939-21ssh12:30:552
3252399250,24cyclictest15312-21/usr/sbin/munin10:27:112
3252399250,24cyclictest0-21swapper/209:40:402
32521992523,1cyclictest0-21swapper/108:50:011
3252199250,1cyclictest22677-21apt-get11:02:051
3251699250,25cyclictest0-21swapper/010:39:570
32526992422,1cyclictest34-21ksoftirqd/312:25:003
3252699241,22cyclictest0-21swapper/311:32:133
3252699240,23cyclictest25864-21diskmemload12:01:393
3252699240,23cyclictest25864-21diskmemload11:55:043
3252699240,23cyclictest25864-21diskmemload11:43:423
3252699240,23cyclictest0-21swapper/310:39:223
3252699240,23cyclictest0-21swapper/310:16:253
3252699240,23cyclictest0-21swapper/309:37:453
3252699240,1cyclictest0-21swapper/310:55:063
3252399240,24cyclictest0-21swapper/210:15:132
3252399240,23cyclictest25864-21diskmemload09:23:252
3252399240,23cyclictest19633-21apt-get11:57:052
3252399240,23cyclictest0-21swapper/210:48:032
3252399240,1cyclictest25558-21ssh11:32:142
3252399240,1cyclictest0-21swapper/210:57:242
3252199240,24cyclictest0-21swapper/110:39:521
3252199240,24cyclictest0-21swapper/110:16:141
3252199240,23cyclictest25864-21diskmemload10:21:241
3252199240,23cyclictest19118-21ssh10:29:541
3252199240,23cyclictest0-21swapper/112:37:371
3252199240,23cyclictest0-21swapper/109:54:161
3252199240,0cyclictest25864-21diskmemload11:59:141
3252199240,0cyclictest0-21swapper/112:18:241
32516992421,2cyclictest313-21systemd-journal10:10:010
3251699240,24cyclictest0-21swapper/012:26:270
3251699240,24cyclictest0-21swapper/011:07:010
3251699240,23cyclictest3437-21ssh12:10:490
3251699240,23cyclictest0-21swapper/012:01:150
3251699240,23cyclictest0-21swapper/009:54:230
3251699240,1cyclictest10858-21ssh11:19:530
3251699240,0cyclictest0-21swapper/011:36:480
3251699240,0cyclictest0-21swapper/010:16:510
32526992323,0cyclictest0-21swapper/312:30:463
32526992323,0cyclictest0-21swapper/311:49:123
32526992323,0cyclictest0-21swapper/309:25:443
32526992322,1cyclictest0-21swapper/311:13:313
32526992322,1cyclictest0-21swapper/310:05:333
32526992322,0cyclictest34-21ksoftirqd/311:00:183
32526992322,0cyclictest0-21swapper/307:37:033
3252699232,1cyclictest34-21ksoftirqd/310:02:093
32526992321,1cyclictest7417-21cstates11:17:063
32526992321,1cyclictest0-21swapper/312:09:023
3252699230,23cyclictest0-21swapper/311:38:383
3252699230,23cyclictest0-21swapper/311:20:573
3252699230,23cyclictest0-21swapper/310:22:233
3252699230,22cyclictest8959-21ssh09:22:543
3252699230,22cyclictest21235-21sh09:33:373
3252699230,22cyclictest0-21swapper/310:31:393
3252699230,22cyclictest0-21swapper/307:32:043
3252699230,0cyclictest25864-21diskmemload10:41:123
3252699230,0cyclictest25864-21diskmemload09:11:183
3252699230,0cyclictest0-21swapper/311:52:103
3252699230,0cyclictest0-21swapper/311:05:483
3252699230,0cyclictest0-21swapper/309:15:523
32523992323,0cyclictest25257-21apt-get10:07:052
32523992323,0cyclictest0-21swapper/211:53:212
32523992323,0cyclictest0-21swapper/210:01:422
32523992322,1cyclictest22628-21ssh11:02:032
32523992321,1cyclictest5307-21perf11:15:002
32523992321,1cyclictest0-21swapper/209:57:152
32523992321,1cyclictest0-21swapper/209:26:472
32523992320,2cyclictest30923-21idleruntime-cro10:40:002
32523992319,4cyclictest0-21swapper/211:43:192
3252399231,1cyclictest14351-21diskmemload12:20:212
3252399230,23cyclictest0-21swapper/212:26:322
3252399230,23cyclictest0-21swapper/209:37:392
3252399230,23cyclictest0-21swapper/209:32:022
3252399230,22cyclictest6074-21diskmemload09:49:132
3252399230,22cyclictest29159-21ssh11:36:322
3252399230,22cyclictest0-21swapper/212:37:052
3252399230,22cyclictest0-21swapper/211:27:172
3252399230,1cyclictest0-21swapper/211:18:132
3252399230,0cyclictest0-21swapper/212:01:562
32521992323,0cyclictest25864-21diskmemload09:59:171
32521992323,0cyclictest25864-21diskmemload09:30:341
32521992323,0cyclictest25864-21diskmemload09:11:501
32521992323,0cyclictest0-21swapper/112:12:541
32521992323,0cyclictest0-21swapper/110:55:551
32521992323,0cyclictest0-21swapper/110:45:081
32521992323,0cyclictest0-21swapper/110:42:261
32521992323,0cyclictest0-21swapper/110:00:081
32521992322,1cyclictest25864-21diskmemload12:20:321
32521992322,1cyclictest25864-21diskmemload11:15:431
32521992321,1cyclictest2131-21ssh09:46:101
32521992321,1cyclictest0-21swapper/109:22:041
3252199230,2cyclictest6032-21ssh11:44:161
3252199230,2cyclictest13895-21sh11:52:011
3252199230,23cyclictest31484-21sh09:42:191
3252199230,23cyclictest25864-21diskmemload09:25:321
3252199230,22cyclictest29130-21cron12:05:001
3252199230,22cyclictest23649-21ssh09:36:371
3252199230,22cyclictest22921-21ssh11:30:371
3252199230,22cyclictest21349-21sh11:28:481
3252199230,22cyclictest19906-21sh10:30:041
3252199230,22cyclictest15642-21ssh11:23:451
3252199230,0cyclictest25864-21diskmemload12:25:521
3252199230,0cyclictest0-21swapper/112:34:151
3252199230,0cyclictest0-21swapper/111:47:261
3252199230,0cyclictest0-21swapper/111:12:351
32516992323,0cyclictest25864-21diskmemload09:37:050
32516992323,0cyclictest0-21swapper/011:22:250
32516992323,0cyclictest0-21swapper/010:48:290
32516992323,0cyclictest0-21swapper/010:33:110
32516992323,0cyclictest0-21swapper/010:00:280
32516992323,0cyclictest0-21swapper/009:33:130
32516992323,0cyclictest0-21swapper/009:15:150
32516992322,1cyclictest62550irq/127-eno111:11:290
32516992322,1cyclictest25864-21diskmemload10:52:360
3251699230,23cyclictest25864-21diskmemload09:49:440
3251699230,23cyclictest0-21swapper/009:41:040
3251699230,22cyclictest25864-21diskmemload10:55:070
3251699230,22cyclictest18821-21runrttasks11:55:580
3251699230,22cyclictest16902-21ssh11:25:070
3251699230,22cyclictest12003-21ssh09:26:470
3251699230,22cyclictest0-21swapper/011:52:090
3251699230,1cyclictest25864-21diskmemload11:47:150
3251699230,1cyclictest0-21swapper/010:20:410
3251699230,0cyclictest25864-21diskmemload11:31:340
3251699230,0cyclictest0-21swapper/012:07:400
3251699230,0cyclictest0-21swapper/011:40:460
3251699230,0cyclictest0-21swapper/010:42:240
3251699230,0cyclictest0-21swapper/010:11:310
32526992222,0cyclictest25864-21diskmemload10:27:413
32526992222,0cyclictest0-21swapper/310:45:343
32526992220,1cyclictest3425-21sh12:10:483
32526992220,1cyclictest0-21swapper/309:50:373
32526992220,1cyclictest0-21swapper/309:45:083
32526992220,0cyclictest151rcu_preempt11:27:573
3252699220,21cyclictest9673-21ls07:30:003
3252699220,21cyclictest0-21swapper/307:57:053
3252699220,1cyclictest29572-21apt-get09:42:063
3252699220,0cyclictest0-21swapper/310:13:263
32523992222,0cyclictest0-21swapper/211:46:152
32523992222,0cyclictest0-21swapper/209:15:062
32523992220,1cyclictest0-21swapper/210:50:302
32523992220,1cyclictest0-21swapper/210:22:092
3252399220,2cyclictest31816-21idleruntime-cro08:15:002
3252399220,22cyclictest0-21swapper/210:30:352
3252399220,21cyclictest25864-21diskmemload12:15:142
3252399220,21cyclictest25864-21diskmemload12:10:322
3252399220,21cyclictest0-21swapper/211:20:162
3252399220,1cyclictest29683-21sh10:10:262
3252399220,1cyclictest0-21swapper/211:05:052
3252399220,0cyclictest0-21swapper/210:40:132
32521992221,1cyclictest32235-21ssh09:15:351
32521992221,1cyclictest28047-21ssh11:35:011
32521992221,1cyclictest1471-21sh12:09:021
3252199220,21cyclictest438-21apt-get07:12:031
3252199220,21cyclictest24357-21rm10:05:491
3252199220,1cyclictest31158-21ssh11:08:381
3252199220,1cyclictest18680-21perf08:55:001
3252199220,1cyclictest0-21swapper/109:05:001
3252199220,0cyclictest0-21swapper/108:07:051
32516992221,1cyclictest0-21swapper/012:35:220
32516992221,1cyclictest0-21swapper/009:57:110
32516992220,1cyclictest31824-21ls08:15:000
32516992220,1cyclictest0-21swapper/009:21:190
3251699220,21cyclictest0-21swapper/012:20:590
3251699220,21cyclictest0-21swapper/011:00:120
3251699220,21cyclictest0-21swapper/008:37:040
3251699220,21cyclictest0-21swapper/007:12:030
3251699220,1cyclictest6611-21sh08:30:000
3251699220,1cyclictest26655-21ssh12:31:570
3251699220,0cyclictest0-21swapper/009:11:520
32526992121,0cyclictest0-21swapper/310:50:103
32526992120,1cyclictest25864-21diskmemload09:56:363
3252699210,21cyclictest0-21swapper/312:16:583
3252699210,20cyclictest0-21swapper/308:27:043
3252699210,1cyclictest27450-21apt-get08:07:053
32523992120,1cyclictest12989-21apt-get07:37:032
3252399210,20cyclictest7703-21apt-get07:27:062
3252399210,20cyclictest0-21swapper/208:07:052
3252399210,1cyclictest15460-21apt-get07:42:042
32521992121,0cyclictest0-21swapper/107:30:021
3252199210,21cyclictest0-21swapper/110:11:151
3252199210,0cyclictest2890-21apt-get07:17:061
3252199210,0cyclictest25864-21diskmemload10:50:101
32516992121,0cyclictest0-21swapper/008:07:050
32516992119,1cyclictest4840-21cron07:20:000
32516992119,1cyclictest13881-21cron08:45:010
3251699210,20cyclictest0-21swapper/007:57:050
32526992020,0cyclictest5303-21apt-get07:22:043
32526992020,0cyclictest0-21swapper/307:47:053
32526992017,2cyclictest34-21ksoftirqd/307:20:003
3252699200,0cyclictest0-21swapper/309:07:043
32523992020,0cyclictest0-21swapper/208:57:052
32523992020,0cyclictest0-21swapper/207:12:042
32523992019,0cyclictest0-21swapper/208:17:062
32523992018,1cyclictest24638-21perf08:00:012
3252399200,20cyclictest0-21swapper/207:47:052
32521992020,0cyclictest0-21swapper/109:07:041
32521992020,0cyclictest0-21swapper/107:52:061
3252199200,0cyclictest0-21swapper/108:12:031
32516992020,0cyclictest0-21swapper/009:02:050
32516992020,0cyclictest0-21swapper/008:47:050
32516992020,0cyclictest0-21swapper/008:22:050
32516992020,0cyclictest0-21swapper/007:42:040
32516992020,0cyclictest0-21swapper/007:30:020
3251699200,20cyclictest0-21swapper/007:52:060
32526991919,0cyclictest0-21swapper/308:32:043
32526991918,1cyclictest0-21swapper/308:02:053
32523991919,0cyclictest9675-21apt-get07:30:022
32523991919,0cyclictest0-21swapper/208:42:032
32523991919,0cyclictest0-21swapper/208:02:052
32523991918,1cyclictest9442-21apt-get08:37:042
32523991918,1cyclictest0-21swapper/208:52:052
32521991919,0cyclictest0-21swapper/107:57:051
32521991919,0cyclictest0-21swapper/107:22:031
32516991919,0cyclictest17852-21apt-get07:47:050
32526991818,0cyclictest0-21swapper/308:57:053
32526991817,0cyclictest20246-21apt-get07:52:053
32523991818,0cyclictest2256-21apt-get08:22:042
32523991816,1cyclictest0-21swapper/208:30:002
32521991816,1cyclictest0-21swapper/107:27:071
32516991818,0cyclictest0-21swapper/008:17:060
32516991818,0cyclictest0-21swapper/007:37:040
32523991717,0cyclictest0-21swapper/207:17:062
32521991717,0cyclictest0-21swapper/108:31:111
32516991717,0cyclictest16703-21apt-get08:52:050
3251699170,16cyclictest7324-21cut07:25:000
32526991616,0cyclictest0-21swapper/308:52:053
32526991616,0cyclictest0-21swapper/308:47:053
32526991616,0cyclictest0-21swapper/308:17:063
32526991614,1cyclictest31810-21cron08:15:003
32526991614,1cyclictest17451-21munin-run07:45:013
32523991616,0cyclictest0-21swapper/208:32:052
3252399160,1cyclictest25898-21/usr/sbin/munin09:10:002
32521991616,0cyclictest0-21swapper/108:42:031
32521991615,0cyclictest0-21swapper/108:22:041
32516991616,0cyclictest19099-21apt-get08:57:050
32516991616,0cyclictest0-21swapper/008:32:040
32516991613,2cyclictest9690-21munin-run07:30:000
3251699160,1cyclictest0-21swapper/009:08:550
32526991513,1cyclictest13906-21munin-run08:45:013
3252399150,0cyclictest0-21swapper/207:22:032
32521991515,0cyclictest4650-21apt-get08:27:041
32521991512,2cyclictest19832-21perf07:50:011
32526991414,0cyclictest0-21swapper/307:10:273
3252699140,14cyclictest0-21swapper/309:00:363
3252699140,0cyclictest0-21swapper/308:35:413
3252699140,0cyclictest0-21swapper/308:20:553
3252399140,14cyclictest0-21swapper/208:46:492
3252399140,14cyclictest0-21swapper/207:51:282
32521991414,0cyclictest0-21swapper/108:35:041
32521991414,0cyclictest0-21swapper/107:41:401
3252199140,14cyclictest0-21swapper/108:55:581
3252199140,14cyclictest0-21swapper/107:35:171
3251699140,0cyclictest0-21swapper/008:00:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional