You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 18:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Dec 08, 2025 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22656122080,2sleep3586-21kworker/3:2-events09:10:013
3544222720,4sleep20-21swapper/211:16:132
105131996458,4cyclictest290872-21kworker/u8:2+flush-8:010:16:241
3741492620,2sleep3586-21kworker/3:2+mm_percpu_wq11:36:133
105131996047,9cyclictest282-21systemd-journal12:31:591
105131995750,5cyclictest131517-21kworker/u8:1+flush-8:008:36:271
105127995747,7cyclictest271172-21latency_hist09:55:010
1842022550,3chrt281rcuc/108:26:091
105131995549,4cyclictest131517-21kworker/u8:1+events_unbound07:56:171
105131995549,4cyclictest100314-21kworker/u8:2+events_unbound07:46:131
105131995448,4cyclictest176964-21kworker/u8:2+events_unbound08:21:201
105131995446,5cyclictest109723-21kworker/u8:0+events_unbound09:36:231
105131995445,7cyclictest246206-21kworker/u8:2+flush-8:010:01:151
105127995447,4cyclictest136692-21latency_hist07:40:010
105127995447,4cyclictest136692-21latency_hist07:40:010
105131995347,4cyclictest413052-21kworker/u8:1+events_unbound12:16:191
105131995347,4cyclictest315445-21kworker/u8:2+events_unbound11:46:141
105131995143,5cyclictest285176-21kworker/u8:1+events_unbound11:06:141
105131995045,4cyclictest285176-21kworker/u8:1+flush-8:010:26:231
105131995044,4cyclictest429622-21kworker/u8:0+events_unbound12:36:091
105131995042,6cyclictest315445-21kworker/u8:2+flush-8:011:11:141
105131994943,4cyclictest226183-21kworker/u8:3+flush-8:009:46:201
105131994941,5cyclictest226183-21kworker/u8:3+flush-8:009:21:211
105131994843,4cyclictest285176-21kworker/u8:1+flush-8:010:36:231
105131994843,3cyclictest109723-21kworker/u8:0+events_unbound08:06:181
105131994842,4cyclictest246206-21kworker/u8:2+flush-8:009:56:111
105131994841,5cyclictest109723-21kworker/u8:0+flush-8:008:11:151
105137994739,5cyclictest282-21systemd-journal10:40:002
105131994742,4cyclictest226183-21kworker/u8:3+flush-8:010:31:071
105131994740,5cyclictest226183-21kworker/u8:3+flush-8:011:26:151
105131994640,5cyclictest226183-21kworker/u8:3+flush-8:009:51:181
105131994638,6cyclictest52590-21kworker/u8:3+flush-8:007:26:171
105127994635,8cyclictest282-21systemd-journal10:20:000
105137994539,4cyclictest226183-21kworker/u8:3+flush-8:010:06:192
105131994540,3cyclictest176964-21kworker/u8:2+events_unbound08:31:211
105131994539,4cyclictest285176-21kworker/u8:1+events_unbound11:01:241
105131994538,6cyclictest52590-21kworker/u8:3+flush-8:007:21:161
105127994535,8cyclictest430129-21/usr/sbin/munin12:36:140
105131994440,3cyclictest226183-21kworker/u8:3+events_unbound12:01:201
105131994436,6cyclictest109723-21kworker/u8:0+flush-8:008:41:141
105127994436,6cyclictest276404-21/usr/sbin/munin10:01:150
3329922430,2sleep3481ktimers/310:56:113
105131994337,5cyclictest109723-21kworker/u8:0+events_unbound09:31:221
1922112420,5sleep20-21swapper/208:36:132
105131994238,3cyclictest390015-21kworker/u8:0+events_unbound12:26:071
105131994236,4cyclictest390015-21kworker/u8:0+events_unbound12:06:201
105131994236,4cyclictest209062-21kworker/u8:2+flush-8:009:06:161
105137994137,3cyclictest131517-21kworker/u8:1+events_unbound09:26:222
105137994135,4cyclictest131517-21kworker/u8:1+flush-8:008:01:212
105131994136,3cyclictest3456629-21kworker/u8:1+events_unbound07:11:171
105131994136,3cyclictest315445-21kworker/u8:2+flush-8:011:36:041
105131994135,4cyclictest315445-21kworker/u8:2+flush-8:010:51:161
105131994134,5cyclictest226183-21kworker/u8:3+events_unbound10:11:071
105131994133,6cyclictest131517-21kworker/u8:1+events_unbound08:56:171
105137994036,3cyclictest109723-21kworker/u8:0+flush-8:007:21:202
105131994036,3cyclictest226183-21kworker/u8:3+flush-8:012:21:201
105131994034,4cyclictest209062-21kworker/u8:2+events_unbound09:01:231
105131994034,4cyclictest131517-21kworker/u8:1+events_unbound07:51:111
105131994033,5cyclictest315445-21kworker/u8:2+flush-8:010:56:171
105131994033,5cyclictest226183-21kworker/u8:3+flush-8:011:31:171
105131994032,5cyclictest100314-21kworker/u8:2+flush-8:007:41:191
105131994027,10cyclictest282-21systemd-journal12:15:001
105131993934,3cyclictest315445-21kworker/u8:2+flush-8:010:41:231
105127993934,3cyclictest109723-21kworker/u8:0+events_unbound08:06:050
105127993930,7cyclictest296441-21/usr/sbin/munin10:21:150
105127993930,6cyclictest126762-21latency_hist07:30:010
105137993834,3cyclictest109723-21kworker/u8:0+flush-8:010:11:232
105137993828,8cyclictest282-21systemd-journal08:47:492
105131993833,4cyclictest131517-21kworker/u8:1+events_unbound09:26:081
105131993833,3cyclictest315445-21kworker/u8:2+flush-8:011:51:211
105131993831,5cyclictest157063-21apt-get08:01:001
105127993829,7cyclictest195665-21ntpq08:36:220
1047762384,10sleep10-21swapper/107:07:481
105137993732,3cyclictest226183-21kworker/u8:3+events_unbound12:01:072
105131993733,3cyclictest186616-21kworker/u8:3+events_unbound08:46:201
105131993732,4cyclictest315445-21kworker/u8:2+flush-8:011:21:151
105131993731,4cyclictest109723-21kworker/u8:0+events_unbound08:16:051
105131993724,9cyclictest282-21systemd-journal11:40:581
105131993629,5cyclictest315445-21kworker/u8:2+flush-8:011:16:161
105127993631,3cyclictest246206-21kworker/u8:2+events_unbound10:06:130
105137993527,6cyclictest282-21systemd-journal08:15:012
105131993530,4cyclictest131517-21kworker/u8:1+events_unbound07:36:061
105131993530,4cyclictest131517-21kworker/u8:1+events_unbound07:36:051
105131993524,8cyclictest282-21systemd-journal11:58:591
1915662340,6chrt0-21swapper/208:35:002
105137993429,4cyclictest226183-21kworker/u8:3+events_unbound09:16:212
105131993429,3cyclictest297196-21irqrtprio10:21:101
105137993329,3cyclictest390015-21kworker/u8:0+flush-8:012:21:222
105131993329,3cyclictest131517-21kworker/u8:1+flush-8:009:11:201
105127993326,5cyclictest226183-21kworker/u8:3+flush-8:011:26:160
105137993227,4cyclictest290872-21kworker/u8:2+flush-8:010:21:172
105137993227,3cyclictest315445-21kworker/u8:2+flush-8:012:11:082
105137993224,6cyclictest282-21systemd-journal07:20:002
105137993126,3cyclictest345199-21unixbench_singl11:06:222
105137993123,6cyclictest282-21systemd-journal07:41:152
2942402300,5sleep3451irq_work/310:16:153
105137993025,3cyclictest360031-21unixbench_singl11:21:222
105137993024,4cyclictest147108-21kworker/u8:3+flush-8:007:51:122
105131993025,4cyclictest52590-21kworker/u8:3+flush-8:007:16:101
105131993020,8cyclictest285091-21ntpq10:06:161
105127993025,3cyclictest147741-21irqcore07:51:100
105127993022,5cyclictest276082-21latency_hist10:00:010
105127993021,6cyclictest360375-21latency_hist11:25:000
105137992924,4cyclictest315445-21kworker/u8:2+flush-8:011:51:132
105137992924,4cyclictest226183-21kworker/u8:3+flush-8:011:26:202
105137992924,3cyclictest146854-21gpgv07:50:012
105131992924,4cyclictest52590-21kworker/u8:3+flush-8:007:32:511
105131992923,5cyclictest226183-21kworker/u8:3+events_unbound09:16:091
105127992924,4cyclictest109723-21kworker/u8:0+flush-8:009:31:200
10512799292,25cyclictest95209-21kworker/0:1+events08:01:010
105127992920,7cyclictest216850-21munin-node09:01:030
105137992825,2cyclictest177085-21aten2_r5power_c08:21:042
105137992823,4cyclictest109723-21kworker/u8:0+flush-8:008:56:212
105137992820,6cyclictest282-21systemd-journal11:00:002
105131992821,5cyclictest256700-21apt-get09:41:021
10512799282,24cyclictest95209-21kworker/0:1+events07:46:180
105127992822,4cyclictest109723-21kworker/u8:0+events_unbound07:15:020
105127992820,6cyclictest206400-21latency_hist08:50:010
105127992820,6cyclictest137001-21/usr/sbin/munin07:41:210
105137992723,2cyclictest291708-21cpuspeed_turbos10:16:072
105137992723,2cyclictest136331-21unixbench_singl07:36:232
105137992723,2cyclictest136331-21unixbench_singl07:36:232
105137992720,5cyclictest282-21systemd-journal11:50:002
105127992722,3cyclictest375210-21systemd-run11:40:000
10512799272,23cyclictest365329-21kworker/0:2+events11:56:180
105127992721,4cyclictest241380-21apt-key09:25:010
105127992720,5cyclictest186616-21kworker/u8:3+flush-8:008:41:040
105127992718,7cyclictest282-21systemd-journal07:34:590
105127992712,12cyclictest370242-21latency_hist11:35:010
105137992623,2cyclictest410599-21fschecks_count12:16:052
105137992623,2cyclictest225513-21tail09:06:132
105137992622,3cyclictest315445-21kworker/u8:2+events_unbound10:41:052
105137992622,2cyclictest434760-21basename12:40:002
105137992621,4cyclictest131517-21kworker/u8:1+events_unbound09:20:022
105127992622,2cyclictest0-21swapper/012:14:590
105127992620,4cyclictest315445-21kworker/u8:2+flush-8:011:46:120
10512799261,24cyclictest166742-21kworker/0:0+events08:51:570
105137992522,2cyclictest266829-21fschecks_count09:51:062
105137992521,2cyclictest280699-21unixbench_singl10:01:232
105137992521,2cyclictest210933-21unixbench_multi08:51:232
105131992521,3cyclictest315445-21kworker/u8:2+flush-8:010:46:191
105131992517,5cyclictest206702-21/usr/sbin/munin08:51:211
10512799253,21cyclictest166742-21kworker/0:0+events08:56:060
10512799252,22cyclictest166742-21kworker/0:0+events08:11:060
105127992520,3cyclictest397521-21kthreadcore12:01:120
105127992518,5cyclictest226183-21kworker/u8:3+flush-8:012:21:180
105127992518,5cyclictest131517-21kworker/u8:1+flush-8:008:21:190
105127992517,6cyclictest330724-21latency_hist10:55:010
105137992421,2cyclictest217225-21fschecks_time09:01:082
105137992420,2cyclictest256354-21sendmail09:40:002
105137992419,4cyclictest52590-21kworker/u8:3+events_unbound07:31:092
105137992419,4cyclictest126422-21unixbench_singl07:26:222
105137992419,3cyclictest256965-21fschecks_count09:41:072
105137992417,5cyclictest614-21lldpd11:01:122
10513799240,8cyclictest1844731kthreadcore08:26:092
10512799242,21cyclictest221543-21kworker/0:1+events09:06:180
10512799242,21cyclictest166742-21kworker/0:0+events08:17:140
105127992419,3cyclictest290770-21unixbench_multi10:11:250
105127992419,3cyclictest191171-21unixbench_multi08:31:240
105127992418,4cyclictest379750-21unixbench_multi11:41:240
105127992416,5cyclictest231400-21latency_hist09:15:010
105127992413,10cyclictest829-21mta-sts-daemon07:55:320
10512799241,22cyclictest241399-21kworker/0:2+events09:25:050
105137992319,2cyclictest271609-21aten2_r5power_v09:56:042
10512799236,16cyclictest365329-21kworker/0:2+events12:06:100
10512799236,16cyclictest306304-21kworker/0:0+events11:11:020
10512799236,16cyclictest306304-21kworker/0:0+events11:06:020
10512799236,16cyclictest306304-21kworker/0:0+events11:01:060
10512799234,18cyclictest241399-21kworker/0:2+events09:36:140
10512799232,20cyclictest241399-21kworker/0:2+events10:25:460
105127992319,2cyclictest232448-21irqrtprio09:16:110
105127992319,2cyclictest0-21swapper/007:15:000
105127992318,3cyclictest18912-21cron12:35:000
105127992317,4cyclictest412575-21kthreadcore12:16:110
105127992315,6cyclictest226183-21kworker/u8:3+flush-8:009:41:170
10512799230,22cyclictest241399-21kworker/0:2+events09:46:220
1046982233,14sleep00-21swapper/007:06:460
10513799227,3cyclictest3021352cut10:26:112
10512799225,16cyclictest306304-21kworker/0:0+events10:56:140
10512799222,19cyclictest306304-21kworker/0:0+events10:44:340
10512799220,21cyclictest241399-21kworker/0:2+events10:31:170
105137992117,2cyclictest261969-21fschecks_time09:46:072
105137992116,4cyclictest424347-21kworker/u8:2+events_unbound12:26:342
10513799210,7cyclictest166601-21idleruntime-cro08:10:002
10512799216,14cyclictest306304-21kworker/0:0+events11:17:060
10512799214,16cyclictest306304-21kworker/0:0+events10:36:220
105127992111,3cyclictest0-21swapper/007:21:030
10512799210,20cyclictest365329-21kworker/0:2+events11:54:300
10513799202,13cyclictest390327-21apt-get11:56:062
10513799202,12cyclictest345870-21apt-get11:11:032
105137992011,7cyclictest372768-21tr11:36:112
105137992010,7cyclictest152951-21sed07:56:122
10512799204,15cyclictest306304-21kworker/0:0+events10:46:180
10512799202,17cyclictest414954-21kworker/0:0+events12:26:140
105127992016,2cyclictest0-21swapper/008:26:090
1003532204,12sleep20-21swapper/207:05:352
10513799193,12cyclictest375521-21apt-get11:41:052
105137991914,4cyclictest0-21swapper/208:44:592
105137991912,5cyclictest308801-21cut10:31:132
105137991911,6cyclictest326861-21sed10:51:112
105137991910,7cyclictest428846-21grep12:31:132
105137991910,7cyclictest249391-21tr09:31:152
1003322183,8sleep30-21swapper/307:05:213
10513799179,6cyclictest403036-21tr12:06:162
105137991713,2cyclictest0-21swapper/211:31:082
105137991713,2cyclictest0-21swapper/210:46:112
10513799162,7cyclictest0-21swapper/207:11:092
105137991612,2cyclictest0-21swapper/209:11:102
105137991611,4cyclictest172835-21tr08:16:082
3585812156,6sleep30-21swapper/311:21:133
2555012156,5sleep30-21swapper/309:36:183
4209862145,5sleep30-21swapper/312:26:103
1366692142,7sleep30-21swapper/307:40:003
1366692142,7sleep30-21swapper/307:39:593
4298122132,6sleep30-21swapper/312:35:003
4114862132,7sleep30-21swapper/312:16:113
4039592132,7sleep30-21swapper/312:06:193
3988252132,7sleep30-21swapper/312:01:143
3693772132,7sleep30-21swapper/311:31:163
3496642132,7sleep30-21swapper/311:11:183
3214712131,8sleep30-21swapper/310:46:093
2964402133,6sleep30-21swapper/310:21:013
2669382132,7sleep30-21swapper/309:51:063
1608522132,7sleep30-21swapper/308:01:153
1267832133,6sleep30-21swapper/307:30:013
4255182122,6sleep30-21swapper/312:31:083
4193362122,6sleep30-21swapper/312:21:233
4095092122,6sleep30-21swapper/312:12:053
3858662122,6sleep30-21swapper/311:51:113
3844392122,6sleep30-21swapper/311:46:203
3754952122,6sleep30-21swapper/311:41:033
3508082122,6sleep30-21swapper/311:16:033
3455332121,7sleep30-21swapper/311:10:013
3372612122,6sleep30-21swapper/311:01:143
3265922122,6sleep30-21swapper/310:51:113
3208432122,6sleep30-21swapper/310:45:003
3013762122,6sleep30-21swapper/310:26:033
2821982122,6sleep30-21swapper/310:06:113
2720032122,6sleep30-21swapper/309:56:093
2613042122,6sleep30-21swapper/309:44:533
2468502122,6sleep30-21swapper/309:31:093
2420442122,6sleep30-21swapper/309:26:073
2370622122,6sleep30-21swapper/309:21:143
2357452122,6sleep30-21swapper/309:16:233
2199372121,6sleep30-21swapper/309:01:143
2060462122,6sleep30-21swapper/308:46:263
1918842122,6sleep30-21swapper/308:36:033
1872582122,6sleep30-21swapper/308:31:093
1726132122,6sleep30-21swapper/308:16:083
1671332122,6sleep30-21swapper/308:10:583
1518872122,6sleep30-21swapper/307:55:013
1370872122,6sleep30-21swapper/307:41:053
1225232122,6sleep30-21swapper/307:26:083
3941422112,5sleep30-21swapper/311:56:203
3612142112,5sleep30-21swapper/311:26:103
3117732112,5sleep30-21swapper/310:36:103
3063432112,6sleep30-21swapper/310:31:043
2866012112,5sleep30-21swapper/310:11:063
2764032112,5sleep30-21swapper/310:01:033
2613452112,5sleep30-21swapper/309:45:013
2270412112,5sleep30-21swapper/309:11:063
2115802112,6sleep30-21swapper/308:55:373
2109092112,5sleep30-21swapper/308:51:243
1969442112,6sleep30-21swapper/308:41:043
1819592112,6sleep30-21swapper/308:25:423
1767072111,6sleep30-21swapper/308:20:023
1620252112,6sleep30-21swapper/308:06:053
1470602112,5sleep30-21swapper/307:50:123
1463562112,5sleep30-21swapper/307:47:073
1174522112,5sleep30-21swapper/307:21:063
1118252112,5sleep30-21swapper/307:15:043
1053542112,6sleep30-21swapper/307:11:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional