You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 10:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed Jun 03, 2026 00:45:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1211222070,8sleep1131rcu_preempt19:10:481
2225821150,3chrt0-21swapper/321:15:283
2225821150,3chrt0-21swapper/321:15:283
42832980,2sleep30-21swapper/322:51:333
42832980,2sleep30-21swapper/322:51:333
288202980,3sleep00-21swapper/000:38:370
288202980,3sleep00-21swapper/000:38:370
321872920,2chrt0-21swapper/221:26:242
321872920,2chrt0-21swapper/221:26:242
321872920,2chrt0-21swapper/221:26:242
58522880,5sleep012-21ksoftirqd/000:10:350
58522880,5sleep012-21ksoftirqd/000:10:350
58522880,5sleep012-21ksoftirqd/000:10:350
215542810,2sleep10-21swapper/100:30:341
215542810,2sleep10-21swapper/100:30:341
242572760,3sleep123569-21/usr/sbin/munin19:55:321
242572760,3sleep123569-21/usr/sbin/munin19:55:321
247262750,2sleep20-21swapper/200:34:372
247262750,2sleep20-21swapper/200:34:372
157112720,3sleep015691-21ssh23:05:370
157112720,3sleep015691-21ssh23:05:370
310492710,4sleep30-21swapper/321:25:283
310492710,4sleep30-21swapper/321:25:283
310492710,4sleep30-21swapper/321:25:283
199222680,2sleep10-21swapper/121:12:001
199222680,2sleep10-21swapper/121:12:001
199222680,2sleep10-21swapper/121:12:001
120682670,3sleep10-21swapper/123:01:031
120682670,3sleep10-21swapper/123:01:031
120682670,3sleep10-21swapper/123:01:031
115322670,2chrt0-21swapper/100:18:281
115322670,2chrt0-21swapper/100:18:281
120952660,2sleep210715-21ls19:10:382
51292650,3sleep10-21swapper/122:53:081
51292650,3sleep10-21swapper/122:53:081
256522640,3sleep30-21swapper/323:55:353
256522640,3sleep30-21swapper/323:55:353
165142640,2sleep30-21swapper/323:06:563
165142640,2sleep30-21swapper/323:06:563
183972570,3chrt0-21swapper/322:29:513
183972570,3chrt0-21swapper/322:29:513
50892560,3chrt0-21swapper/022:11:150
50892560,3chrt0-21swapper/022:11:150
50892560,3chrt0-21swapper/022:11:150
59612550,3chrt0-21swapper/323:32:363
59612550,3chrt0-21swapper/323:32:363
59612550,3chrt0-21swapper/323:32:363
81382540,1sleep08219-21strings23:35:280
81382540,1sleep08219-21strings23:35:280
81382540,1sleep08219-21strings23:35:280
75162530,2sleep07533-21ssh23:35:200
75162530,2sleep07533-21ssh23:35:200
75162530,2sleep07533-21ssh23:35:200
230392530,3sleep00-21swapper/022:35:260
256132510,3sleep00-21swapper/020:00:260
256132510,3sleep00-21swapper/020:00:260
256132510,3sleep00-21swapper/020:00:260
131902510,3sleep10-21swapper/119:20:121
120232500,4sleep10-21swapper/121:41:421
120232500,4sleep10-21swapper/121:41:421
112952480,3sleep010715-21ls19:10:280
257582460,2sleep025770-21sh23:17:230
257582460,2sleep025770-21sh23:17:230
257582460,2sleep025770-21sh23:17:230
96082440,2sleep30-21swapper/322:17:333
96082440,2sleep30-21swapper/322:17:333
96082440,2sleep30-21swapper/322:17:333
284782440,3sleep00-21swapper/020:07:370
284782440,3sleep00-21swapper/020:07:370
284782440,3sleep00-21swapper/020:07:370
185612440,3chrt0-21swapper/021:10:300
185612440,3chrt0-21swapper/021:10:300
185612440,3chrt0-21swapper/021:10:300
204842430,3sleep00-21swapper/022:31:240
204842430,3sleep00-21swapper/022:31:240
67352420,3sleep10-21swapper/100:12:011
67352420,3sleep10-21swapper/100:12:011
67352420,3sleep10-21swapper/100:12:011
300792420,2sleep10-21swapper/121:24:581
300792420,2sleep10-21swapper/121:24:581
297512410,3sleep20-21swapper/220:10:322
297512410,3sleep20-21swapper/220:10:322
7352400,2sleep0856-21mailstats20:20:320
7352400,2sleep0856-21mailstats20:20:320
51272400,2chrt0-21swapper/122:11:201
51272400,2chrt0-21swapper/122:11:201
51272400,2chrt0-21swapper/122:11:201
266152390,3sleep00-21swapper/023:56:570
266152390,3sleep00-21swapper/023:56:570
1215699391,14cyclictest4170-21ntp_states22:10:312
1215699391,14cyclictest4170-21ntp_states22:10:312
1215699391,14cyclictest4170-21ntp_states22:10:312
189472380,4sleep00-21swapper/023:10:270
189472380,4sleep00-21swapper/023:10:270
17562380,3sleep11753-21find00:05:381
17562380,3sleep11753-21find00:05:381
149472380,3sleep30-21swapper/319:25:123
149472380,3sleep30-21swapper/319:25:123
146032370,3sleep20-21swapper/222:24:512
146032370,3sleep20-21swapper/222:24:512
146032370,3sleep20-21swapper/222:24:512
130812360,2sleep00-21swapper/020:55:270
130812360,2sleep00-21swapper/020:55:270
1215699363,28cyclictest29070-21ssh00:00:182
1215699363,28cyclictest29070-21ssh00:00:182
1215699361,9cyclictest12899-21irqstats20:55:252
1215699361,9cyclictest12899-21irqstats20:55:252
1215699361,11cyclictest2725-21memory21:30:422
1215699361,11cyclictest2725-21memory21:30:422
1215699361,11cyclictest2725-21memory21:30:422
236582350,3sleep00-21swapper/000:33:020
236582350,3sleep00-21swapper/000:33:020
195682350,4sleep10-21swapper/121:50:381
195682350,4sleep10-21swapper/121:50:381
1215699352,29cyclictest13171-21sendmail19:20:122
1215699351,3cyclictest29356-21ssh00:00:252
1215699351,3cyclictest29356-21ssh00:00:252
1215699351,3cyclictest29356-21ssh00:00:252
1215699351,12cyclictest14019-21ntp_states19:20:262
1215699351,12cyclictest14019-21ntp_states19:20:262
261852340,3sleep00-21swapper/021:58:170
261852340,3sleep00-21swapper/021:58:170
1215699348,24cyclictest32045-21/usr/sbin/munin23:25:272
1215699348,24cyclictest32045-21/usr/sbin/munin23:25:272
1215699348,24cyclictest32045-21/usr/sbin/munin23:25:272
1215699342,28cyclictest28095-21grep22:40:352
1215699342,28cyclictest28095-21grep22:40:352
1215699341,8cyclictest22931-21latency_hist22:35:252
1215699341,8cyclictest22931-21latency_hist22:35:252
1215699341,8cyclictest22931-21latency_hist22:35:252
1215699341,6cyclictest13436-21tr00:20:322
1215699341,6cyclictest13436-21tr00:20:322
1215699340,8cyclictest31158-21/usr/sbin/munin20:15:282
11592340,3sleep30-21swapper/320:20:343
11592340,3sleep30-21swapper/320:20:343
308852330,3sleep10-21swapper/123:23:341
308852330,3sleep10-21swapper/123:23:341
308852330,3sleep10-21swapper/123:23:341
231222330,4sleep023118-21ssh21:15:370
231222330,4sleep023118-21ssh21:15:370
192532330,3sleep10-21swapper/100:28:011
192532330,3sleep10-21swapper/100:28:011
1215699337,23cyclictest27323-21cat21:20:342
1215699337,23cyclictest27323-21cat21:20:342
1215699331,9cyclictest28584-21ntp_states22:00:322
1215699331,9cyclictest28584-21ntp_states22:00:322
1215699331,9cyclictest28584-21ntp_states22:00:322
1215699331,9cyclictest18671-21memory19:40:242
1215699331,9cyclictest18671-21memory19:40:242
1215699331,8cyclictest7770-21taskset22:55:362
1215699331,8cyclictest7770-21taskset22:55:362
1215699331,8cyclictest7770-21taskset22:55:362
1215699331,7cyclictest7596-21/usr/sbin/munin23:35:312
1215699331,7cyclictest7596-21/usr/sbin/munin23:35:312
1215699331,7cyclictest7596-21/usr/sbin/munin23:35:312
1215699331,7cyclictest19168-21users21:10:362
1215699331,7cyclictest19168-21users21:10:362
1215699331,7cyclictest19168-21users21:10:362
1215699331,7cyclictest17430-21chrt21:49:142
1215699331,7cyclictest17430-21chrt21:49:142
1215699331,6cyclictest6253-21taskset22:55:122
1215699331,6cyclictest6253-21taskset22:55:122
1215699331,6cyclictest23419-21if_eth021:55:262
1215699331,6cyclictest23419-21if_eth021:55:262
1215699331,10cyclictest31254-21perl22:45:262
1215699331,10cyclictest31254-21perl22:45:262
1215699331,10cyclictest31254-21perl22:45:262
1215699330,7cyclictest15824-21rt-features22:25:312
1215699330,7cyclictest15824-21rt-features22:25:312
1215699330,7cyclictest10200-21sh00:16:012
1215699330,7cyclictest10200-21sh00:16:012
1215699330,6cyclictest14566-21/usr/sbin/munin23:05:322
1215699330,6cyclictest14566-21/usr/sbin/munin23:05:322
92702320,3sleep30-21swapper/322:58:243
92702320,3sleep30-21swapper/322:58:243
92702320,3sleep30-21swapper/322:58:243
229192320,5sleep30-21swapper/321:55:183
229192320,5sleep30-21swapper/321:55:183
1215699326,23cyclictest11069-21cat20:50:262
1215699326,23cyclictest11069-21cat20:50:262
1215699321,9cyclictest19414-21cut23:50:132
1215699321,9cyclictest19414-21cut23:50:132
1215699321,8cyclictest7555-21wc23:35:212
1215699321,8cyclictest7555-21wc23:35:212
1215699321,8cyclictest7555-21wc23:35:212
1215699321,8cyclictest7176-21ssh00:12:532
1215699321,8cyclictest7176-21ssh00:12:532
1215699321,8cyclictest7176-21ssh00:12:532
1215699321,8cyclictest25227-21latency_hist20:00:162
1215699321,8cyclictest25227-21latency_hist20:00:162
1215699321,8cyclictest23812-21unixbench_singl22:35:342
1215699321,8cyclictest23812-21unixbench_singl22:35:342
1215699321,8cyclictest23420-21fschecks_count23:15:232
1215699321,8cyclictest23420-21fschecks_count23:15:232
1215699321,8cyclictest23420-21fschecks_count23:15:232
1215699321,8cyclictest22191-21tune2fs21:15:272
1215699321,8cyclictest22191-21tune2fs21:15:272
1215699321,8cyclictest21254-21ssh23:51:022
1215699321,8cyclictest21254-21ssh23:51:022
1215699321,8cyclictest1147-21unixbench_multi20:20:342
1215699321,8cyclictest1147-21unixbench_multi20:20:342
1215699321,6cyclictest21105-21taskset21:52:502
1215699321,6cyclictest21105-21taskset21:52:502
1215699321,5cyclictest14067-21sh23:04:472
1215699321,5cyclictest14067-21sh23:04:472
1215699321,5cyclictest14067-21sh23:04:472
1215699321,4cyclictest32602-21ntp_states22:05:322
1215699321,4cyclictest32602-21ntp_states22:05:322
1215699321,4cyclictest19304-21ssh00:28:062
1215699321,4cyclictest19304-21ssh00:28:062
1215699321,12cyclictest16400-21ntp_states19:30:272
1215699320,9cyclictest10675-21memory21:40:282
1215699320,9cyclictest10675-21memory21:40:282
1215699320,8cyclictest27260-21fschecks_count20:05:282
1215699320,8cyclictest27260-21fschecks_count20:05:282
1215699320,8cyclictest27260-21fschecks_count20:05:282
1215699320,8cyclictest20354-21kernelversion19:45:272
1215699320,8cyclictest20354-21kernelversion19:45:272
1215699320,8cyclictest20354-21kernelversion19:45:272
1215699320,7cyclictest9540-21ssh22:17:252
1215699320,7cyclictest9540-21ssh22:17:252
1215699320,7cyclictest9540-21ssh22:17:252
1215599321,23cyclictest30529-21ssh00:00:461
1215599321,23cyclictest30529-21ssh00:00:461
1215599321,23cyclictest30529-21ssh00:00:461
84922310,3sleep00-21swapper/022:56:570
84922310,3sleep00-21swapper/022:56:570
84922310,3sleep00-21swapper/022:56:570
1215699313,24cyclictest2935-21unixbench_multi20:25:342
1215699313,24cyclictest2935-21unixbench_multi20:25:342
1215699313,24cyclictest2935-21unixbench_multi20:25:342
1215699311,9cyclictest22097-21ssh23:13:552
1215699311,9cyclictest22097-21ssh23:13:552
1215699311,7cyclictest3747-21fschecks_count20:30:262
1215699311,7cyclictest3747-21fschecks_count20:30:262
1215699311,7cyclictest29136-21sort23:20:352
1215699311,7cyclictest29136-21sort23:20:352
1215699311,7cyclictest29136-21sort23:20:352
1215699311,7cyclictest25630-21fschecks_count00:35:252
1215699311,7cyclictest25630-21fschecks_count00:35:252
1215699311,7cyclictest22551-21grep19:50:312
1215699311,7cyclictest22551-21grep19:50:312
1215699311,7cyclictest1314-21sed00:05:322
1215699311,7cyclictest1314-21sed00:05:322
1215699311,7cyclictest12452-21/usr/sbin/munin23:40:322
1215699311,7cyclictest12452-21/usr/sbin/munin23:40:322
1215699311,6cyclictest16212-21entropy21:05:252
1215699311,6cyclictest16212-21entropy21:05:252
1215699311,6cyclictest16212-21entropy21:05:252
1215699311,6cyclictest15501-21sshd19:29:372
1215699311,6cyclictest15501-21sshd19:29:372
1215699311,6cyclictest10239-21/usr/sbin/munin21:40:232
1215699311,6cyclictest10239-21/usr/sbin/munin21:40:232
1215699311,5cyclictest9090-21fschecks_count20:45:262
1215699311,5cyclictest9090-21fschecks_count20:45:262
1215699311,5cyclictest25628-21fschecks_time20:00:262
1215699311,5cyclictest25628-21fschecks_time20:00:262
1215699311,5cyclictest25628-21fschecks_time20:00:262
1215699310,7cyclictest15648-21sshd21:02:352
1215699310,7cyclictest15648-21sshd21:02:352
1215699310,7cyclictest15648-21sshd21:02:352
74572300,2sleep17467-21ssh21:35:481
74572300,2sleep17467-21ssh21:35:481
152242300,3sleep10-21swapper/121:00:351
152242300,3sleep10-21swapper/121:00:351
152242300,3sleep10-21swapper/121:00:351
1215699301,7cyclictest8446-21taskset20:41:452
1215699301,7cyclictest8446-21taskset20:41:452
1215699300,6cyclictest5385-21sort20:35:242
1215699300,6cyclictest5385-21sort20:35:242
319212280,3sleep00-21swapper/022:05:240
319212280,3sleep00-21swapper/022:05:240
248972280,2sleep112153-21cyclictest23:16:071
248972280,2sleep112153-21cyclictest23:16:071
248972280,2sleep112153-21cyclictest23:16:071
1215699280,6cyclictest17569-21seq19:35:302
1215699280,6cyclictest17569-21seq19:35:302
56742270,3sleep3321rcuc/300:10:343
56742270,3sleep3321rcuc/300:10:343
56742270,3sleep3321rcuc/300:10:343
47202270,3chrt0-21swapper/321:33:123
47202270,3chrt0-21swapper/321:33:123
47202270,3chrt0-21swapper/321:33:123
295532270,3sleep00-21swapper/020:10:300
295532270,3sleep00-21swapper/020:10:300
12154992719,5cyclictest29741-21memory00:00:290
12154992719,5cyclictest29741-21memory00:00:290
12154992719,5cyclictest29741-21memory00:00:290
293852260,2chrt0-21swapper/322:01:053
293852260,2chrt0-21swapper/322:01:053
293852260,2chrt0-21swapper/322:01:053
111322260,3sleep30-21swapper/323:39:483
111322260,3sleep30-21swapper/323:39:483
111322260,3sleep30-21swapper/323:39:483
264032250,5sleep126400-21grep20:00:351
264032250,5sleep126400-21grep20:00:351
264032250,5sleep126400-21grep20:00:351
12154992516,6cyclictest8918-21ssh00:15:280
12154992516,6cyclictest8918-21ssh00:15:280
325482240,3sleep30-21swapper/322:46:143
325482240,3sleep30-21swapper/322:46:143
325482240,3sleep30-21swapper/322:46:143
308772240,3sleep30-21swapper/322:45:223
308772240,3sleep30-21swapper/322:45:223
233392240,3sleep10-21swapper/123:54:051
233392240,3sleep10-21swapper/123:54:051
124722240,2sleep30-21swapper/323:40:323
124722240,2sleep30-21swapper/323:40:323
1215599241,20cyclictest6974-21tr20:40:121
1215599241,20cyclictest6974-21tr20:40:121
12154992417,4cyclictest17849-21rm21:10:210
12154992417,4cyclictest17849-21rm21:10:210
12154992417,4cyclictest17849-21rm21:10:210
12154992416,5cyclictest27841-21/usr/sbin/munin22:00:350
115312240,15sleep30-21swapper/319:10:313
202782230,3sleep30-21swapper/319:45:263
202782230,3sleep30-21swapper/319:45:263
202782230,3sleep30-21swapper/319:45:263
159822230,2sleep30-21swapper/300:24:213
159822230,2sleep30-21swapper/300:24:213
12155992315,5cyclictest1690-21ssh23:27:051
12155992315,5cyclictest1690-21ssh23:27:051
12155992315,5cyclictest1690-21ssh23:27:051
12155992314,7cyclictest11483-21/usr/sbin/munin20:50:321
12155992314,7cyclictest11483-21/usr/sbin/munin20:50:321
12154992316,4cyclictest11325-21ssh22:20:250
12154992316,4cyclictest11325-21ssh22:20:250
12154992316,4cyclictest11325-21ssh22:20:250
12154992313,7cyclictest3343-21/usr/sbin/munin21:30:490
12154992313,7cyclictest3343-21/usr/sbin/munin21:30:490
12154992313,7cyclictest3343-21/usr/sbin/munin21:30:490
12154992311,9cyclictest23108-21ssh21:55:230
1215499231,19cyclictest12958-21cut00:20:270
1215499231,19cyclictest12958-21cut00:20:270
1215499231,18cyclictest964-21cut00:05:290
1215499231,18cyclictest964-21cut00:05:290
1215499231,14cyclictest11629-21ls23:00:340
1215499231,14cyclictest11629-21ls23:00:340
1215499231,14cyclictest11629-21ls23:00:340
105402230,2sleep30-21swapper/320:50:123
105402230,2sleep30-21swapper/320:50:123
36322221,2sleep10-21swapper/121:31:101
36322221,2sleep10-21swapper/121:31:101
36322221,2sleep10-21swapper/121:31:101
293882220,4chrt0-21swapper/300:00:263
293882220,4chrt0-21swapper/300:00:263
293882220,4chrt0-21swapper/300:00:263
1215599229,11cyclictest29077-21cups-browsed00:00:191
1215599229,11cyclictest29077-21cups-browsed00:00:191
12155992213,7cyclictest1442-21ssh21:29:301
12155992213,7cyclictest1442-21ssh21:29:301
12155992213,7cyclictest1442-21ssh21:29:301
1215599221,14cyclictest15525-21ls23:05:351
1215599221,14cyclictest15525-21ls23:05:351
1215599221,14cyclictest13376-21ls20:55:311
1215599221,14cyclictest13376-21ls20:55:311
1215499228,11cyclictest19451-21rm21:50:360
1215499222,11cyclictest14873-21needreboot21:00:300
1215499222,11cyclictest14873-21needreboot21:00:300
1215499222,11cyclictest14873-21needreboot21:00:300
1215499221,18cyclictest26963-21sort22:40:230
1215499221,18cyclictest26963-21sort22:40:230
1215499221,11cyclictest15960-21grep22:25:320
1215499221,11cyclictest15960-21grep22:25:320
1215499221,11cyclictest12384-21sh23:40:320
1215499221,11cyclictest12384-21sh23:40:320
1215499220,19cyclictest10241-21ls21:40:230
1215499220,19cyclictest10241-21ls21:40:230
1215599211,18cyclictest4481-21ls20:30:341
1215599211,18cyclictest4481-21ls20:30:341
1215599211,17cyclictest12250-21strings23:40:291
1215599211,17cyclictest12250-21strings23:40:291
1215599211,16cyclictest16503-21ls21:05:281
1215599211,16cyclictest16503-21ls21:05:281
1215599211,16cyclictest16503-21ls21:05:281
1215599211,15cyclictest27183-21ssh22:40:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional