You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 19:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Dec 09, 2025 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21595921750,3sleep3586-21kworker/3:2+events12:31:073
41091772700,5sleep00-21swapper/007:26:120
1714782690,5sleep20-21swapper/211:46:272
4089944995950,7cyclictest37256-21kworker/u8:2+flush-8:009:51:120
4089952995450,3cyclictest4131489-21kworker/u8:2+flush-8:008:26:132
4089952995348,3cyclictest101292-21kworker/u8:2+events_unbound11:51:202
4089952995146,4cyclictest160790-21kworker/u8:3+flush-8:012:21:192
4089952995046,3cyclictest151140-21kworker/u8:1+events_unbound12:01:192
4089949995043,5cyclictest4161647-21kworker/u8:4+flush-8:009:21:191
4089944994839,7cyclictest215498-21/usr/sbin/munin12:31:130
4089952994743,3cyclictest4161647-21kworker/u8:4+events_unbound09:30:002
4089952994641,4cyclictest209954-21kworker/u8:2+flush-8:012:26:182
4089949994641,4cyclictest4171331-21kworker/u8:1+flush-8:008:41:051
4089944994636,7cyclictest282-21systemd-journal07:15:010
4089949994540,4cyclictest4176537-21kworker/u8:0+flush-8:011:31:191
4089944994536,6cyclictest75691-21ntpq10:06:140
4089949994434,7cyclictest282-21systemd-journal10:19:191
4089944994435,7cyclictest67013-21/usr/sbin/munin10:01:200
4089952994336,6cyclictest151140-21kworker/u8:1+flush-8:011:26:102
4089952994238,3cyclictest4176537-21kworker/u8:0+flush-8:010:51:262
4089949994234,6cyclictest282-21systemd-journal11:10:011
4089944994236,5cyclictest4161647-21kworker/u8:4+flush-8:008:51:060
4089944994231,9cyclictest4180400-21ntpq08:36:140
4089952994137,3cyclictest76604-21kworker/u8:3+events_unbound10:31:142
4089952994137,3cyclictest76604-21kworker/u8:3+events_unbound10:31:142
4089952994136,4cyclictest4171331-21kworker/u8:1+events_unbound10:11:262
4089949994135,4cyclictest185731-21kworker/u8:0+flush-8:012:31:061
4089944994134,5cyclictest4136423-21latency_hist07:55:000
4089944994134,5cyclictest4136423-21latency_hist07:55:000
4089944994134,4cyclictest155834-21latency_hist11:30:000
4089944994130,9cyclictest282-21systemd-journal12:04:590
4089949994033,5cyclictest4171331-21kworker/u8:1+events_unbound10:26:181
4089949994033,5cyclictest4171331-21kworker/u8:1+events_unbound10:26:181
4089949994029,8cyclictest282-21systemd-journal12:38:191
4089949993931,5cyclictest4097076-21kworker/u8:1+flush-8:007:36:221
4089952993833,4cyclictest4089814-21kworker/u8:0+events_unbound07:21:132
4089949993834,3cyclictest4069978-21kworker/u8:2+events_unbound07:15:021
4089949993828,8cyclictest4094013-21ntpq07:11:141
4089944993829,7cyclictest282-21systemd-journal09:30:000
4089944993828,7cyclictest91402-21latency_hist10:25:000
40895492384,10sleep10-21swapper/107:07:041
4089952993733,3cyclictest4176537-21kworker/u8:0+events_unbound09:41:132
4089952993731,4cyclictest4097076-21kworker/u8:1+flush-8:007:41:242
4089949993731,4cyclictest4131489-21kworker/u8:2+flush-8:008:31:211
4089944993729,6cyclictest4176266-21latency_hist08:35:010
4089949993629,5cyclictest46928-21cron09:40:001
4089949993624,9cyclictest282-21systemd-journal12:09:191
4089944993629,5cyclictest4190302-21ntpq08:46:150
4089944993629,5cyclictest4156075-21grep08:11:270
4089952993530,4cyclictest4171331-21kworker/u8:1+events_unbound09:35:002
4089949993529,4cyclictest151140-21kworker/u8:1+events_unbound11:26:211
4089949993528,5cyclictest69211-21kthreadcore10:01:111
408994499350,31cyclictest37058-21kworker/0:1+events11:30:240
40971982340,2sleep2371rcuc/207:16:032
4089949993428,5cyclictest4097076-21kworker/u8:1+flush-8:008:11:181
4089949993428,4cyclictest151140-21kworker/u8:1+events_unbound12:01:031
4089949993426,6cyclictest282-21systemd-journal09:00:181
4089944993430,3cyclictest4171331-21kworker/u8:1+flush-8:010:26:190
4089944993430,3cyclictest4171331-21kworker/u8:1+flush-8:010:26:190
4089944993426,6cyclictest4089788-21latency_hist07:10:010
4089944993426,6cyclictest17572-21apt-get09:11:010
4089944993425,7cyclictest282-21systemd-journal09:34:590
408994499341,29cyclictest37058-21kworker/0:1+events11:45:240
408994499341,28cyclictest37058-21kworker/0:1+events11:50:400
4089952993328,4cyclictest4161647-21kworker/u8:4+events_unbound09:00:042
4089952993327,4cyclictest4161647-21kworker/u8:4+events_unbound09:00:012
4089952993322,9cyclictest282-21systemd-journal11:40:012
4089949993328,4cyclictest4161647-21kworker/u8:4+events_unbound08:46:181
4089949993327,5cyclictest101292-21kworker/u8:2+flush-8:011:35:501
4089949993326,4cyclictest4097076-21kworker/u8:1+flush-8:007:31:041
4089949993323,7cyclictest282-21systemd-journal07:26:191
4089944993329,3cyclictest76604-21kworker/u8:3+flush-8:011:21:120
4089944993328,3cyclictest4116596-21cron07:35:000
4089944993326,5cyclictest4181550-21/usr/sbin/munin08:41:120
4089944993325,6cyclictest46940-21latency_hist09:40:010
4089952993226,5cyclictest4171331-21kworker/u8:1+flush-8:010:27:242
4089952993226,5cyclictest4171331-21kworker/u8:1+flush-8:010:27:232
4089949993226,4cyclictest37256-21kworker/u8:2+events_unbound09:56:061
4089949993226,4cyclictest116672-21apt-get10:51:011
4089949993216,12cyclictest282-21systemd-journal11:23:191
4089944993223,6cyclictest27118-21latency_hist09:20:010
408994499322,26cyclictest37058-21kworker/0:1+events10:15:040
408994499322,26cyclictest37058-21kworker/0:1+events10:10:440
408994499322,25cyclictest4089824-21kworker/0:1+events07:35:080
4089944993221,8cyclictest145952-21latency_hist11:20:010
408994499321,30cyclictest37058-21kworker/0:1+events12:13:400
408994499321,26cyclictest37058-21kworker/0:1+events12:05:560
40895922324,9sleep20-21swapper/207:07:372
4089949993127,3cyclictest76604-21kworker/u8:3+flush-8:010:30:501
4089949993127,3cyclictest76604-21kworker/u8:3+flush-8:010:30:501
4089949993126,3cyclictest16333-21needreboot09:06:221
4089949993125,4cyclictest4097076-21kworker/u8:1+flush-8:007:41:221
4089949993125,4cyclictest181616-21irqrtprio11:56:081
4089949993124,5cyclictest4176537-21kworker/u8:0+flush-8:010:36:161
4089949993121,7cyclictest4171331-21kworker/u8:1+flush-8:009:26:151
4089944993127,3cyclictest102547-21irqrtprio10:36:100
4089944993124,5cyclictest282-21systemd-journal07:55:190
4089944993124,5cyclictest282-21systemd-journal07:55:180
408994499312,25cyclictest37058-21kworker/0:1+events12:15:040
408994499312,24cyclictest37058-21kworker/0:1+events11:35:400
408994499312,24cyclictest37058-21kworker/0:1+events10:40:400
408994499312,24cyclictest37058-21kworker/0:1+events10:40:400
408994499311,29cyclictest37058-21kworker/0:1+events11:13:510
4089952993026,2cyclictest200784-21aten2_r5power_v12:16:032
4089952993025,4cyclictest4089814-21kworker/u8:0+events_unbound07:46:242
4089952993025,4cyclictest4089814-21kworker/u8:0+events_unbound07:46:242
4089952993025,4cyclictest151140-21kworker/u8:1+events_unbound12:33:282
4089949993025,4cyclictest4176537-21kworker/u8:0+flush-8:008:36:151
4089949993025,4cyclictest160790-21kworker/u8:3+events_unbound12:16:161
4089949993025,3cyclictest4132520-21irqrtprio07:51:071
4089949993025,3cyclictest4132520-21irqrtprio07:51:071
4089949993024,4cyclictest4089814-21kworker/u8:0+events_unbound07:56:081
4089949993024,4cyclictest4089814-21kworker/u8:0+events_unbound07:56:081
4089949993024,4cyclictest209954-21kworker/u8:2+events_unbound12:26:051
4089949993023,5cyclictest160790-21kworker/u8:3+events_unbound12:11:231
4089949993023,5cyclictest101292-21kworker/u8:2+flush-8:011:46:341
4089949993018,8cyclictest282-21systemd-journal10:14:181
4089949993016,10cyclictest282-21systemd-journal10:45:001
4089949993016,10cyclictest282-21systemd-journal10:44:591
4089944993026,2cyclictest76604-21kworker/u8:3+flush-8:010:55:500
408994499300,28cyclictest4089824-21kworker/0:1+events08:06:020
4089949992924,3cyclictest4089814-21kworker/u8:0+flush-8:008:01:501
4089949992923,5cyclictest4176537-21kworker/u8:0+flush-8:009:41:151
4089949992923,4cyclictest101292-21kworker/u8:2+events_unbound10:46:041
4089944992926,2cyclictest215186-21cron12:30:000
408994499292,26cyclictest4191187-21kworker/0:0+events09:09:360
408994499292,26cyclictest37058-21kworker/0:1+events11:40:560
408994499292,26cyclictest37058-21kworker/0:1+events10:52:160
408994499292,22cyclictest4089824-21kworker/0:1+events08:20:200
408994499292,22cyclictest4089824-21kworker/0:1+events08:00:520
1845482290,10sleep013-21ksoftirqd/011:56:120
4089952992822,4cyclictest4176537-21kworker/u8:0+flush-8:010:01:242
4089949992822,4cyclictest4089814-21kworker/u8:0+flush-8:008:22:231
4089949992814,10cyclictest282-21systemd-journal10:09:591
4089944992825,2cyclictest7354-21sendmail09:00:000
408994499282,25cyclictest37058-21kworker/0:1+events10:34:200
408994499282,25cyclictest37058-21kworker/0:1+events10:34:190
4089944992822,4cyclictest4176537-21kworker/u8:0+flush-8:010:46:310
408994499281,26cyclictest4191187-21kworker/0:0+events09:21:280
408994499281,26cyclictest4089824-21kworker/0:1+events07:24:200
408994499281,22cyclictest37058-21kworker/0:1+events12:35:110
408994499280,27cyclictest37058-21kworker/0:1+events11:00:080
4089952992720,5cyclictest4171331-21kworker/u8:1+flush-8:009:12:242
4089952992717,8cyclictest2258-21cp08:55:012
4089949992722,3cyclictest141009-21systemd-run11:15:011
4089949992722,2cyclictest0-21swapper/108:16:061
4089949992721,4cyclictest4089814-21kworker/u8:0+events_unbound08:06:111
4089949992721,2cyclictest0-21swapper/111:51:141
4089944992724,2cyclictest12300-21turbostat.cron09:05:000
408994499272,21cyclictest37058-21kworker/0:1+events11:05:120
408994499271,25cyclictest4089824-21kworker/0:1+events08:19:520
408994499271,22cyclictest4089824-21kworker/0:1+events07:45:040
408994499271,22cyclictest4089824-21kworker/0:1+events07:45:040
408994499271,22cyclictest4089824-21kworker/0:1+events07:40:360
408994499271,21cyclictest37058-21kworker/0:1+events12:20:160
4089952992622,2cyclictest111824-21aten2_r5power_p10:46:032
4089952992621,4cyclictest101292-21kworker/u8:2+events_unbound11:02:272
4089949992622,2cyclictest56870-21systemd-run09:50:001
4089949992621,3cyclictest4167234-21irqcore08:26:061
4089949992620,4cyclictest101292-21kworker/u8:2+events_unbound11:01:161
4089949992619,5cyclictest4176537-21kworker/u8:0+events_unbound09:16:141
4089949992618,6cyclictest4129006-21kthreadcore07:46:121
4089949992618,6cyclictest4129006-21kthreadcore07:46:111
4089949992614,9cyclictest2163-21apt-get08:55:001
408994499266,19cyclictest37058-21kworker/0:1+events09:47:350
408994499261,24cyclictest4089824-21kworker/0:1+events08:25:360
408994499261,24cyclictest4089824-21kworker/0:1+events07:19:280
4089952992521,3cyclictest4137282-21fschecks_count07:56:092
4089952992521,3cyclictest4137282-21fschecks_count07:56:092
4089952992520,3cyclictest4171331-21kworker/u8:1+events_unbound09:20:012
4089952992518,1cyclictest421rcuog/212:06:072
4089952992514,9cyclictest282-21systemd-journal09:20:002
4089949992518,5cyclictest4176537-21kworker/u8:0+events_unbound11:16:171
4089949992516,7cyclictest282-21systemd-journal10:21:191
408994499252,22cyclictest37058-21kworker/0:1+events09:43:440
4089952992420,3cyclictest151140-21kworker/u8:1+events_unbound12:10:022
4089952992420,3cyclictest0-21swapper/212:40:002
4089952992420,2cyclictest52330-21aten2_r5power_p09:46:062
4089952992420,2cyclictest4162096-21cut08:21:052
4089952992420,2cyclictest156276-21aten2_r5power_v11:31:042
4089949992420,2cyclictest0-21swapper/107:21:021
4089949992419,3cyclictest101292-21kworker/u8:2+events_unbound11:41:121
4089949992418,4cyclictest41668-21unixbench_singl09:31:231
4089949992418,2cyclictest0-21swapper/109:51:181
4089944992422,1cyclictest0-21swapper/009:56:200
408995299238,2cyclictest75489-21seq10:06:122
4089952992320,2cyclictest4176948-21fschecks_time08:36:052
4089952992319,2cyclictest141402-21aten2_r5power_p11:16:042
4089949992319,2cyclictest0-21swapper/108:56:261
4089949992318,4cyclictest4161647-21kworker/u8:4+flush-8:009:11:211
408995299229,10cyclictest282-21systemd-journal07:36:182
4089952992218,2cyclictest4147250-21fschecks_time08:06:062
4089952992218,2cyclictest0-21swapper/210:20:002
4089952992218,2cyclictest0-21swapper/208:20:012
408995299220,20cyclictest1-21systemd09:55:002
4089949992217,2cyclictest0-21swapper/110:56:221
4089949992216,4cyclictest210244-21idleruntime-cro12:24:591
408995299212,13cyclictest62106-21apt-get09:56:032
4089952992117,3cyclictest4171331-21kworker/u8:1+events_unbound09:05:182
4089952992116,3cyclictest0-21swapper/207:55:002
4089952992116,3cyclictest0-21swapper/207:54:592
4089952992115,4cyclictest136451-21cut11:11:022
4089952992018,1cyclictest4191154-21cron08:50:002
4089952992016,2cyclictest121805-21cpuspeed_turbos10:56:072
4089952992016,2cyclictest0-21swapper/210:45:002
4089952992016,2cyclictest0-21swapper/210:45:002
4089952992011,7cyclictest4114311-21tr07:31:092
4089952992011,6cyclictest4145802-21sshd08:01:182
40892552193,9sleep30-21swapper/307:06:213
408995299182,2cyclictest161rcu_preempt07:26:102
4089952991814,3cyclictest4151863-21aten2_r5power_c08:11:042
4089952991814,3cyclictest101292-21kworker/u8:2+events_unbound11:42:262
4089952991814,2cyclictest4181798-21cpuspeed_turbos08:41:032
4089952991813,3cyclictest0-21swapper/207:11:132
4089952991810,6cyclictest46933-21sh09:39:592
408995299176,2cyclictest161rcu_preempt11:21:042
408995299172,2cyclictest0-21swapper/210:21:122
4089952991714,2cyclictest4171725-21aten2_r5power_p08:31:022
540182167,5sleep30-21swapper/309:46:143
408995299163,7cyclictest131470-21apt-get11:06:022
4089952991612,2cyclictest0-21swapper/211:56:022
408995299161,11cyclictest101829-21apt-get10:36:032
461682154,7sleep30-21swapper/309:36:193
41851242132,7sleep30-21swapper/308:41:133
41116742132,6sleep30-21swapper/307:30:013
2146732132,6sleep30-21swapper/312:26:223
1607852132,6sleep30-21swapper/311:35:003
955472122,6sleep30-21swapper/310:26:193
955472122,6sleep30-21swapper/310:26:193
864822122,6sleep30-21swapper/310:20:013
813892122,6sleep30-21swapper/310:13:183
680922122,6sleep30-21swapper/310:01:113
656692122,6sleep30-21swapper/309:56:123
617652122,5sleep30-21swapper/309:55:013
41936232122,6sleep30-21swapper/308:51:113
41902292122,6sleep30-21swapper/308:46:143
41607992122,6sleep30-21swapper/308:16:203
41554632122,6sleep30-21swapper/308:11:153
41465862122,6sleep30-21swapper/308:05:013
41418822122,6sleep30-21swapper/308:00:183
41367732122,5sleep30-21swapper/307:55:023
41367732122,5sleep30-21swapper/307:55:023
41270082122,6sleep30-21swapper/307:46:073
41270082122,6sleep30-21swapper/307:46:073
41219242122,6sleep30-21swapper/307:41:053
41171762122,6sleep30-21swapper/307:36:073
40905622123,6sleep30-21swapper/307:11:063
271522122,5sleep30-21swapper/309:20:013
2201512122,6sleep30-21swapper/312:35:013
2097122123,6sleep30-21swapper/312:21:213
2010802122,6sleep30-21swapper/312:16:073
1957602122,6sleep30-21swapper/312:11:083
1954032122,5sleep30-21swapper/312:10:013
1897462122,6sleep30-21swapper/312:01:183
186052123,5sleep30-21swapper/309:11:103
1759382122,6sleep30-21swapper/311:51:023
1711972123,5sleep30-21swapper/311:46:253
1707142122,6sleep30-21swapper/311:45:013
1600362122,6sleep30-21swapper/311:31:203
1516772120,7sleep30-21swapper/311:26:113
1466722122,6sleep30-21swapper/311:21:093
1449252122,6sleep30-21swapper/311:16:153
1336262122,6sleep30-21swapper/311:06:123
126712122,6sleep30-21swapper/309:06:083
1209012122,6sleep30-21swapper/310:51:233
116352122,6sleep30-21swapper/309:01:193
1119772122,6sleep30-21swapper/310:46:043
1023142122,6sleep30-21swapper/310:36:093
966342112,5sleep30-21swapper/310:31:013
966342112,5sleep30-21swapper/310:31:013
817582112,5sleep30-21swapper/310:15:033
720002112,5sleep30-21swapper/310:06:043
476682112,5sleep30-21swapper/309:41:083
41770512112,6sleep30-21swapper/308:36:073
41716422113,5sleep30-21swapper/308:31:013
41712972112,5sleep30-21swapper/308:30:013
41616742112,5sleep30-21swapper/308:20:263
41320412112,5sleep30-21swapper/307:51:043
41320412112,5sleep30-21swapper/307:51:043
41081622112,5sleep30-21swapper/307:26:113
41024052112,5sleep30-21swapper/307:21:063
40971122112,5sleep30-21swapper/307:16:013
377582112,6sleep30-21swapper/309:31:093
323572112,5sleep30-21swapper/309:25:393
26582112,5sleep30-21swapper/308:55:333
225042112,5sleep30-21swapper/309:16:003
1808682112,5sleep30-21swapper/311:56:003
1304862112,5sleep30-21swapper/311:01:223
1218362112,5sleep30-21swapper/310:56:093
1067542112,6sleep30-21swapper/310:41:003
1067542112,6sleep30-21swapper/310:41:003
1363012102,5sleep30-21swapper/311:10:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional