You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 09:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Fri Nov 21, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3079023000,2sleep10-21swapper/119:05:321
3075222740,2sleep214096-1kworker/u9:419:05:292
3071622670,2sleep30-21swapper/319:05:263
3162598112107,3cyclictest10113-21kworker/u8:1619:41:551
3162598106100,4cyclictest5149-21kworker/u8:5123:12:021
31632989285,4cyclictest31-21ksoftirqd/319:41:553
31632988679,5cyclictest31-21ksoftirqd/323:12:033
31625987265,5cyclictest8283-21kworker/u8:2421:02:491
31632985243,6cyclictest31-21ksoftirqd/321:02:483
31625984841,4cyclictest19-21ksoftirqd/122:42:091
183482440,2sleep218343-21ssh22:28:562
31625984338,3cyclictest16000-21kworker/u8:419:57:161
3162298433,10cyclictest252932kworker/u9:020:42:220
3162298433,10cyclictest252932kworker/u9:020:42:210
45292420,14sleep10-21swapper/100:13:191
55102410,2sleep24382-21/usr/sbin/munin22:00:432
150532400,2sleep10-21swapper/100:35:021
3162298398,3cyclictest119750irq/29-4f00000.00:00:010
87662380,2sleep20-21swapper/200:20:472
45212380,2sleep30-21swapper/300:13:173
3162298388,3cyclictest119750irq/29-4f00000.22:15:220
3162298383,9cyclictest18892-21irqrtprio20:00:250
3162298383,9cyclictest18892-21irqrtprio20:00:250
3162298378,22cyclictest119750irq/29-4f00000.19:55:310
3162298371,3cyclictest8375-1kworker/u9:221:20:410
3162298371,3cyclictest8375-1kworker/u9:221:20:400
31622983710,24cyclictest25942-21latency_hist22:45:020
30192370,2sleep2241rcuc/219:20:012
31622983611,22cyclictest25618-21idleruntime-cro20:20:000
310672360,3sleep10-21swapper/121:47:031
310672360,3sleep10-21swapper/121:47:021
27652360,2sleep10-21swapper/121:55:351
253192360,2sleep20-21swapper/222:42:182
3162298353,5cyclictest17294-21sendmail-msp00:40:000
31622983510,3cyclictest18135-21ssh23:35:250
3163298343,2cyclictest121rcu_preempt20:05:143
31632983424,5cyclictest31-21ksoftirqd/322:10:223
3163298341,3cyclictest121rcu_preempt21:15:153
3162298349,22cyclictest30590-21irqrtprio00:00:250
3162298346,3cyclictest119750irq/29-4f00000.00:30:010
3162298345,5cyclictest0-21swapper/019:40:010
3162298345,5cyclictest0-21swapper/019:15:180
3162298345,4cyclictest8375-1kworker/u9:221:20:000
3162298344,8cyclictest21885-21idleruntime-cro20:10:000
3162298343,3cyclictest775-21modprobe23:00:000
3162298343,3cyclictest775-21modprobe22:59:590
3162298341,9cyclictest7412kworker/u9:119:26:430
3162298341,6cyclictest290522kworker/u8:1220:32:120
3162298341,30cyclictest0-21swapper/019:34:590
31622983410,3cyclictest21938-21latency22:35:280
3163298331,5cyclictest121rcu_preempt00:35:183
3162798339,5cyclictest2435-21cron00:10:002
3162798339,5cyclictest2435-21cron00:10:002
3162298336,7cyclictest3495-21idleruntime19:20:210
3162298336,6cyclictest27587-21timerwakeupswit22:45:550
3162298336,5cyclictest17956-21wc23:35:020
3162298335,6cyclictest7175-21grep22:05:250
3162298335,5cyclictest0-21swapper/020:10:410
3162298335,3cyclictest119750irq/29-4f00000.19:40:530
3162298333,8cyclictest10279-21runrttasks23:18:230
3162298333,7cyclictest27790-21tail20:25:190
3162298331,5cyclictest1643-21modprobe21:55:000
3162298331,11cyclictest6169-21aten2_rfpower_f23:10:200
31622983310,3cyclictest1908-21snmpd22:20:380
3162298330,11cyclictest32617-21wc20:35:390
48222320,6sleep10-21swapper/120:49:541
3162798327,9cyclictest8362chrt19:13:172
3162298327,3cyclictest741-1kworker/u9:119:50:000
3162298326,7cyclictest25935-21kernelversion23:50:260
3162298325,4cyclictest30600-21ssh21:45:410
3162298325,4cyclictest30600-21ssh21:45:410
3162298323,6cyclictest0-21swapper/019:10:010
3162298323,4cyclictest7327-21irqrtprio20:55:300
3162298323,4cyclictest7327-21irqrtprio20:55:300
31622983210,19cyclictest6051-21ntp_offset00:15:400
155972320,3sleep20-21swapper/221:15:232
31627983110,4cyclictest29008-21idleruntime22:50:272
3162298319,3cyclictest741-1kworker/u9:119:52:140
3162298318,3cyclictest25293-1kworker/u9:020:45:410
3162298316,3cyclictest119750irq/29-4f00000.22:04:470
3162298315,6cyclictest23285-21processes21:30:420
3162298315,6cyclictest21073-21irqrtprio23:40:250
3162298315,6cyclictest21073-21irqrtprio23:40:250
3162298315,6cyclictest110350irq/20-fttdcc0123:05:320
3162298315,5cyclictest3708-21proc_pri00:10:450
3162298315,5cyclictest0-21swapper/022:00:020
3162298314,7cyclictest13912-21cut23:25:250
3162298314,3cyclictest119750irq/29-4f00000.00:35:020
3162298313,7cyclictest44-21kworker/0:121:30:010
3162298313,7cyclictest119750irq/29-4f00000.21:00:190
3162298313,6cyclictest0-21swapper/000:20:370
3162298313,3cyclictest18885-21ssh22:30:180
3162298313,3cyclictest1368-21cat00:05:400
3162298313,3cyclictest1368-21cat00:05:400
3162298313,3cyclictest11330-21cat21:05:260
3162298312,9cyclictest25483-21ssh21:35:290
3162298312,3cyclictest12589-21/usr/sbin/munin21:10:220
3163298301,3cyclictest121rcu_preempt22:35:143
3162798309,4cyclictest21657-21kworker/u8:1520:15:022
3162298303,5cyclictest18582-21idleruntime-cro22:30:000
3162298303,3cyclictest26657-21runrttasks20:20:340
31622983011,3cyclictest23934-21/usr/sbin/munin23:45:380
215302300,4sleep3301rcuc/321:27:223
129012300,7sleep3121rcu_preempt22:15:433
3162798299,4cyclictest25567-21sh21:35:342
3162798294,3cyclictest860-21modprobe20:40:012
31627982912,3cyclictest12326-21diskmemload00:13:322
31627982910,4cyclictest18319-21ntpq21:20:322
31627982910,4cyclictest18319-21ntpq21:20:312
3162598291,3cyclictest121rcu_preempt20:30:231
3162298296,3cyclictest119750irq/29-4f00000.22:10:370
3162298295,5cyclictest12069-21ssh23:20:450
31622982911,15cyclictest28826-21aten2_rfpower_p22:50:220
59362280,5sleep331-21ksoftirqd/322:01:593
3163298281,3cyclictest121rcu_preempt19:10:173
3162798283,4cyclictest5936-21ntpq00:15:332
3162798281,9cyclictest23444-21munin-plugin-st22:40:012
31627982810,3cyclictest20209-21latency_hist23:40:022
3162598283,4cyclictest121rcu_preempt22:25:191
3162298286,6cyclictest110350irq/20-fttdcc0121:40:230
3162298281,7cyclictest6577-21runrttasks20:53:320
3162298281,6cyclictest0-21swapper/023:00:350
311732280,7sleep225-21ksoftirqd/221:47:362
311732280,7sleep225-21ksoftirqd/221:47:352
271792280,2sleep327175-21ntpq22:45:423
56482270,7sleep2251ksoftirqd/223:09:212
31627982712,3cyclictest12326-21diskmemload23:00:352
158192270,2sleep30-21swapper/319:50:413
125642270,3sleep2251ksoftirqd/219:45:012
45322260,2sleep10-21swapper/123:05:381
3163298266,4cyclictest121rcu_preempt00:25:013
3163298264,6cyclictest31-21ksoftirqd/320:00:013
3162798269,3cyclictest6714-21latency_hist20:55:022
31627982610,4cyclictest1945-21runrttasks21:04:512
3162598269,5cyclictest19-21ksoftirqd/122:15:241
3162598266,5cyclictest121rcu_preempt22:20:181
3162598261,5cyclictest0-21swapper/121:15:231
3162598261,4cyclictest121rcu_preempt23:41:591
3162598261,4cyclictest121rcu_preempt23:41:591
3162598261,3cyclictest121rcu_preempt23:15:591
192102260,2sleep30-21swapper/320:00:343
192102260,2sleep30-21swapper/320:00:343
133322260,10sleep225-21ksoftirqd/223:25:162
12802260,11sleep3121rcu_preempt19:15:153
127912260,1sleep112278-21kworker/u8:119:45:161
123452260,15sleep127932-21kworker/u8:923:21:251
51712250,11sleep331-21ksoftirqd/323:06:523
3163298256,4cyclictest121rcu_preempt21:50:523
3163298256,4cyclictest121rcu_preempt21:15:003
3163298251,4cyclictest0-21swapper/323:00:183
3163298251,3cyclictest121rcu_preempt19:35:403
3162798259,4cyclictest12326-21diskmemload22:33:592
3162798259,3cyclictest12326-21diskmemload22:56:222
3162798259,3cyclictest12326-21diskmemload22:56:222
3162798259,3cyclictest12326-21diskmemload22:20:072
3162598256,4cyclictest121rcu_preempt22:50:331
3162598255,5cyclictest19-21ksoftirqd/122:30:221
3162598251,6cyclictest121rcu_preempt19:30:151
31625982516,5cyclictest191ksoftirqd/119:20:151
170442250,2sleep30-21swapper/323:31:043
147312250,4sleep331-21ksoftirqd/323:26:303
100202250,8sleep3121rcu_preempt23:17:013
317732240,1sleep331-21ksoftirqd/300:02:033
3163298244,5cyclictest1988-21bootmenu19:45:193
3163298242,3cyclictest0-21swapper/322:20:193
3163298241,8cyclictest27476-21latency_hist20:25:013
3162798249,4cyclictest1945-21runrttasks20:59:112
3162798249,4cyclictest1945-21runrttasks20:59:102
3162598249,3cyclictest19-21ksoftirqd/100:20:261
3162598243,5cyclictest19-21ksoftirqd/100:05:131
3162598243,5cyclictest19-21ksoftirqd/100:05:131
3162598243,3cyclictest121rcu_preempt20:00:311
3162598243,3cyclictest121rcu_preempt20:00:311
3162598241,3cyclictest121rcu_preempt22:10:201
3162598241,3cyclictest121rcu_preempt22:00:421
291152240,2sleep329114-21ssh21:44:233
271392240,2sleep2121rcu_preempt20:21:192
266602240,2sleep30-21swapper/321:39:163
264802240,13sleep10-21swapper/121:38:151
253972240,2sleep331617-21cyclictest22:42:443
209962240,2sleep10-21swapper/121:25:401
205842240,2sleep30-21swapper/322:33:033
143992240,5sleep2251ksoftirqd/221:13:022
66482230,2sleep31990-21bootmenu20:54:263
3163298234,4cyclictest121rcu_preempt00:30:003
3163298234,3cyclictest121rcu_preempt21:30:223
3163298233,7cyclictest121rcu_preempt21:20:253
3163298233,7cyclictest121rcu_preempt21:20:243
3162598233,4cyclictest121rcu_preempt23:04:591
3162598233,3cyclictest121rcu_preempt20:15:451
3162598232,4cyclictest121rcu_preempt23:50:151
3162598232,3cyclictest121rcu_preempt20:50:421
3162598232,3cyclictest121rcu_preempt19:10:321
3162598231,3cyclictest121rcu_preempt23:45:321
3162298234,3cyclictest119750irq/29-4f00000.19:10:320
312862230,2sleep329052-21kworker/u8:1220:33:553
283382230,2sleep127925-21kworker/u8:322:49:341
120792230,2sleep10-21swapper/100:29:261
76302220,10sleep225-21ksoftirqd/223:12:102
65422220,11sleep14342-21kworker/u8:300:16:161
3163298225,7cyclictest121rcu_preempt22:25:403
3163298224,4cyclictest31-21ksoftirqd/322:55:053
3163298224,4cyclictest31-21ksoftirqd/322:55:043
3163298223,4cyclictest121rcu_preempt00:07:303
3163298223,4cyclictest121rcu_preempt00:07:303
3163298223,2cyclictest0-21swapper/321:05:383
3163298222,10cyclictest121rcu_preempt22:05:383
3163298221,4cyclictest6957-21apt-get20:55:193
3163298221,4cyclictest6957-21apt-get20:55:193
3163298221,3cyclictest0-21swapper/300:17:273
3162798224,4cyclictest121rcu_preempt19:40:012
3162598229,4cyclictest175002sleep121:20:141
3162598229,4cyclictest175002sleep121:20:131
3162598224,3cyclictest121rcu_preempt21:30:411
3162598223,5cyclictest121rcu_preempt22:55:191
3162598223,5cyclictest121rcu_preempt22:55:191
3162598222,3cyclictest121rcu_preempt23:30:201
3162598222,3cyclictest121rcu_preempt21:05:331
3162598222,3cyclictest121rcu_preempt20:20:361
3162598221,5cyclictest5755-21grep19:25:291
3162598221,5cyclictest121rcu_preempt23:35:421
3162598221,3cyclictest121rcu_preempt22:05:141
3162598221,3cyclictest121rcu_preempt20:40:391
3162598221,3cyclictest121rcu_preempt20:40:391
3162598221,3cyclictest121rcu_preempt19:40:011
3162598221,2cyclictest121rcu_preempt00:35:221
217052220,12sleep225-21ksoftirqd/220:08:082
13612220,1sleep3554-21kworker/u8:520:40:153
13612220,1sleep3554-21kworker/u8:520:40:143
10012220,1sleep11000-21ssh21:51:561
5722210,11sleep331-21ksoftirqd/320:37:253
47452210,11sleep331-21ksoftirqd/320:48:553
46072210,11sleep225-21ksoftirqd/220:47:132
319402210,11sleep2241rcuc/200:02:512
3163298215,8cyclictest121rcu_preempt21:55:183
3163298212,3cyclictest121rcu_preempt22:50:463
3163298212,3cyclictest0-21swapper/320:15:303
31632982114,4cyclictest7792-21ntpq19:30:373
3163298211,3cyclictest0-21swapper/320:25:273
3162598215,13cyclictest19-21ksoftirqd/119:50:141
3162598213,3cyclictest121rcu_preempt22:35:281
3162598213,3cyclictest121rcu_preempt21:10:231
3162598212,3cyclictest121rcu_preempt21:40:161
3162598211,3cyclictest121rcu_preempt23:55:051
3162598211,3cyclictest121rcu_preempt23:25:141
3162598211,3cyclictest121rcu_preempt20:25:341
3162598211,3cyclictest121rcu_preempt00:00:181
3162598210,3cyclictest121rcu_preempt19:15:211
312372210,11sleep331-21ksoftirqd/321:47:563
312372210,11sleep331-21ksoftirqd/321:47:563
167772210,11sleep225-21ksoftirqd/200:37:362
9682200,10sleep225-21ksoftirqd/221:51:462
64552200,10sleep225-21ksoftirqd/219:27:322
47532200,10sleep225-21ksoftirqd/219:24:272
3163298207,9cyclictest122682chrt23:21:033
3163298203,8cyclictest121rcu_preempt23:40:253
3163298203,8cyclictest121rcu_preempt23:40:253
3163298203,10cyclictest121rcu_preempt00:30:303
31632982011,6cyclictest4591-21sshd-session19:22:253
3163298200,8cyclictest121rcu_preempt23:35:383
3163298200,2cyclictest0-21swapper/323:54:233
31627982013,4cyclictest26251-21ntpq23:50:382
31627982013,4cyclictest12326-21diskmemload22:05:152
3162598203,3cyclictest121rcu_preempt20:05:331
3162598202,3cyclictest121rcu_preempt20:10:301
3162598201,4cyclictest121rcu_preempt20:55:201
3162598201,4cyclictest121rcu_preempt20:55:191
3162598201,4cyclictest121rcu_preempt20:35:121
292222200,1sleep317297-21kworker/u8:623:56:413
281982200,10sleep21990-21bootmenu22:48:462
245012200,10sleep21990-21bootmenu23:47:152
222642200,10sleep225-21ksoftirqd/221:30:072
218632200,10sleep21990-21bootmenu23:41:042
218632200,10sleep21990-21bootmenu23:41:042
198082200,10sleep225-21ksoftirqd/220:02:472
198082200,10sleep225-21ksoftirqd/220:02:462
179542200,10sleep225-21ksoftirqd/219:57:592
112312200,8sleep2241rcuc/223:20:262
64432190,9sleep331-21ksoftirqd/319:27:253
3163298191,3cyclictest0-21swapper/320:10:333
31632981913,3cyclictest22962-21aten2_rfpower_e23:45:163
3162798191,3cyclictest121rcu_preempt00:30:232
31627981913,3cyclictest1362-21/usr/sbin/munin20:40:472
31627981913,3cyclictest1362-21/usr/sbin/munin20:40:462
31627981913,3cyclictest10044-21aten2_rfpower_c00:25:162
31627981912,4cyclictest8730-21hddtemp_smartct23:15:202
31627981912,4cyclictest1945-21runrttasks20:18:192
31627981910,6cyclictest21888-21sshd21:29:232
284912190,9sleep225-21ksoftirqd/221:41:082
162062190,8sleep2241rcuc/219:54:132
111712190,9sleep225-21ksoftirqd/222:14:132
109772190,9sleep21990-21bootmenu21:05:222
81722180,8sleep21990-21bootmenu19:30:582
3162798185,3cyclictest121rcu_preempt21:56:092
3162798181,3cyclictest121rcu_preempt22:15:192
31627981811,4cyclictest1945-21runrttasks20:25:342
313632180,8sleep225-21ksoftirqd/220:34:542
290532180,8sleep231617-21cyclictest23:55:502
163932180,7sleep2241rcuc/223:30:272
140912170,7sleep2241rcuc/219:46:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional