You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 17:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Tue Nov 25, 2025 12:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22642890,5sleep32265-21wget01:23:343
24617997118,47cyclictest11291-21unixbench_multi04:48:510
24617997114,11cyclictest6720-21ssh04:43:180
24617996820,42cyclictest28264-21grep03:33:510
24617996819,43cyclictest32206-21/usr/sbin/munin02:43:450
24617996621,38cyclictest25952-21aten_rbpower_cu05:13:290
2461799657,52cyclictest0-21swapper/006:17:360
24617996521,37cyclictest30453-21/usr/sbin/munin04:28:390
24617996518,13cyclictest1695-21/usr/sbin/munin02:48:470
24617996517,13cyclictest17207-21/usr/sbin/munin02:03:550
24617996517,13cyclictest17207-21/usr/sbin/munin02:03:550
24617996318,39cyclictest922-21aten_rbpower_po03:43:300
24617996317,40cyclictest24712-21/usr/sbin/munin02:23:470
24617996317,40cyclictest15094-21taskset01:58:080
2461799629,47cyclictest22873-21kworker/0:006:07:110
24617996219,36cyclictest19846-21ntpq02:08:460
24617996219,36cyclictest19846-21ntpq02:08:460
24617996218,38cyclictest7375-21/usr/sbin/munin06:23:360
24617996216,40cyclictest22707-21latency_hist02:18:210
24617996215,40cyclictest3582-21/usr/sbin/munin02:53:330
24617996213,43cyclictest17893-21fschecks_count03:18:340
24617996213,43cyclictest17893-21fschecks_count03:18:340
24617996118,37cyclictest2213-21/usr/sbin/munin01:23:510
24617996117,38cyclictest9705-21/usr/sbin/munin01:43:390
24617996117,38cyclictest4714-21ntpdc03:48:420
24617996117,38cyclictest24715-21grep04:18:510
24617996117,38cyclictest24715-21grep04:18:510
24629996022,33cyclictest24714-21wc00:58:252
2461799609,44cyclictest32475-21ssh03:41:580
2461799604,50cyclictest0-21swapper/003:33:200
24617996018,36cyclictest7131-21/usr/sbin/munin03:53:490
24617996016,38cyclictest7824-21/usr/sbin/munin01:38:340
24617996016,38cyclictest3202-21runrttasks04:37:290
24617996016,37cyclictest28459-21/usr/sbin/munin02:33:420
24617996015,39cyclictest30332-21/usr/sbin/munin02:38:560
24617996015,39cyclictest19241-21ssh04:11:480
24617996014,40cyclictest4655-21memory06:18:360
24617995918,35cyclictest20299-21fschecks_count04:13:320
24617995917,36cyclictest433-21df01:18:360
24617995916,37cyclictest4087-21/usr/sbin/munin01:28:540
24617995916,37cyclictest31599-21ssh05:21:370
24617995916,37cyclictest29121-21ssh04:27:050
24617995916,37cyclictest28457-21sshd01:04:520
24617995916,36cyclictest10453-21df03:58:310
24617995916,11cyclictest12490-21ssh05:42:460
24617995915,38cyclictest15334-21/usr/sbin/munin01:58:460
24617995915,38cyclictest0-21swapper/005:45:050
24617995914,39cyclictest11582-21/usr/sbin/munin01:48:430
24617995914,38cyclictest0-21swapper/004:53:370
24617995913,40cyclictest5950-21/usr/sbin/munin01:33:420
24617995912,40cyclictest0-21swapper/004:59:280
24617995912,40cyclictest0-21swapper/004:59:280
24617995912,13cyclictest2016-21ssh05:25:250
24617995820,32cyclictest17133-21ssh03:17:330
24617995820,32cyclictest17133-21ssh03:17:330
24617995819,34cyclictest16436-21fschecks_count05:48:330
24617995818,34cyclictest22829-21/usr/sbin/munin02:18:470
24617995817,35cyclictest7111-21df04:43:310
24617995816,37cyclictest6638-21ssh05:33:280
24617995816,36cyclictest30995-21cpu01:13:350
24617995816,36cyclictest29760-21/usr/sbin/munin06:08:350
24617995816,36cyclictest23129-21diskstats05:58:310
24617995815,38cyclictest23830-21ssh05:08:470
24617995815,37cyclictest15591-21ssh04:05:490
24617995815,37cyclictest0-21swapper/003:24:130
24617995813,39cyclictest0-21swapper/003:04:200
2462999575,7cyclictest0-21swapper/204:14:592
24617995718,33cyclictest26589-21/usr/sbin/munin02:28:490
24617995716,36cyclictest4317-21sendmail_mailqu05:28:440
24617995716,13cyclictest21248-21ssh05:04:420
24617995716,13cyclictest21248-21ssh05:04:420
24617995714,37cyclictest0-21swapper/005:54:280
24617995714,37cyclictest0-21swapper/005:54:280
24617995712,39cyclictest0-21swapper/003:02:080
2462999567,43cyclictest0-21swapper/205:39:002
24617995614,37cyclictest29367-21perl01:08:370
24617995612,38cyclictest0-21swapper/003:09:140
2418725612,37sleep10-21swapper/100:56:091
24629995445,5cyclictest29-21ksoftirqd/205:28:172
2462999543,45cyclictest0-21swapper/206:16:232
2462999533,44cyclictest0-21swapper/203:13:402
2462999533,44cyclictest0-21swapper/203:13:402
2462999533,43cyclictest0-21swapper/204:20:222
2462999533,43cyclictest0-21swapper/204:20:222
2462999525,41cyclictest0-21swapper/205:33:042
24629995243,5cyclictest29-21ksoftirqd/203:48:192
2462999524,41cyclictest0-21swapper/206:05:262
2462999524,41cyclictest0-21swapper/202:58:502
2462999524,40cyclictest0-21swapper/204:45:082
2462999523,43cyclictest0-21swapper/205:16:592
24629995212,35cyclictest16681-21fschecks_time04:58:332
24629995212,35cyclictest16681-21fschecks_time04:58:332
2462999515,38cyclictest0-21swapper/204:02:442
2462999514,41cyclictest0-21swapper/204:12:152
2462999514,40cyclictest0-21swapper/203:35:202
2462999513,42cyclictest0-21swapper/206:12:562
2462999505,38cyclictest0-21swapper/203:50:032
2462999504,39cyclictest0-21swapper/205:04:182
2462999504,39cyclictest0-21swapper/205:04:182
2462999503,40cyclictest0-21swapper/205:58:072
2462999503,40cyclictest0-21swapper/205:58:072
2462999503,40cyclictest0-21swapper/204:40:582
2462999503,10cyclictest0-21swapper/204:05:292
24629995011,33cyclictest0-21swapper/203:57:432
24629995010,33cyclictest0-21swapper/204:49:062
2462199503,41cyclictest0-21swapper/104:20:491
2462199503,41cyclictest0-21swapper/104:20:491
2272925010,14sleep20-21swapper/200:53:332
2462999499,34cyclictest0-21swapper/204:34:542
2462999499,33cyclictest0-21swapper/204:28:272
2462999498,34cyclictest0-21swapper/206:21:512
2462999494,39cyclictest0-21swapper/204:25:202
2462999494,38cyclictest0-21swapper/203:30:182
2462999493,40cyclictest14937-21ssh05:45:322
2462999493,40cyclictest0-21swapper/205:18:282
2462999493,40cyclictest0-21swapper/203:19:102
2462999493,40cyclictest0-21swapper/203:19:102
2462999492,41cyclictest25086-21kworker/2:006:01:462
24629994911,5cyclictest0-21swapper/203:10:302
2462199493,41cyclictest0-21swapper/105:17:471
24621994912,31cyclictest0-21swapper/103:12:011
2462999484,38cyclictest0-21swapper/205:37:432
2462999483,39cyclictest0-21swapper/204:54:282
24629994811,31cyclictest0-21swapper/206:27:022
2462199483,40cyclictest0-21swapper/105:30:571
2462199483,40cyclictest0-21swapper/103:36:401
2462999479,5cyclictest0-21swapper/205:50:152
2462999474,37cyclictest0-21swapper/205:08:362
2462999474,37cyclictest0-21swapper/203:24:272
2462999473,37cyclictest0-21swapper/203:38:372
2462999473,14cyclictest0-21swapper/203:03:412
2462199478,33cyclictest0-21swapper/104:47:411
2462199478,33cyclictest0-21swapper/104:36:371
2462199477,34cyclictest0-21swapper/105:38:411
2462199475,35cyclictest0-21swapper/103:14:591
2462199475,35cyclictest0-21swapper/103:14:591
2462199474,37cyclictest0-21swapper/106:24:511
2462199474,37cyclictest0-21swapper/104:29:571
2462199474,37cyclictest0-21swapper/103:45:041
2462199474,36cyclictest0-21swapper/105:55:581
2462199474,36cyclictest0-21swapper/105:55:581
2462199474,17cyclictest0-21swapper/105:51:141
2462199473,38cyclictest0-21swapper/101:33:481
24621994712,30cyclictest0-21swapper/103:53:261
2461799476,36cyclictest0-21swapper/001:01:570
2462199469,6cyclictest0-21swapper/104:06:461
2462199465,34cyclictest0-21swapper/106:09:211
2462199464,36cyclictest0-21swapper/106:22:281
2462199464,36cyclictest0-21swapper/105:09:521
2462199464,17cyclictest0-21swapper/106:16:571
2462199463,38cyclictest0-21swapper/104:24:421
2462199463,38cyclictest0-21swapper/104:08:291
2462199463,38cyclictest0-21swapper/103:31:001
2462199463,38cyclictest0-21swapper/101:03:461
2462199463,37cyclictest0-21swapper/105:20:431
2463699454,36cyclictest0-21swapper/302:33:513
2462199455,8cyclictest0-21swapper/105:45:511
2462199455,34cyclictest0-21swapper/103:49:191
2462199455,33cyclictest0-21swapper/105:25:151
2462199454,16cyclictest0-21swapper/105:01:251
2462199454,16cyclictest0-21swapper/105:01:251
2462199453,37cyclictest0-21swapper/103:06:001
2462199453,36cyclictest0-21swapper/103:26:381
24621994510,5cyclictest0-21swapper/105:37:591
2463699443,36cyclictest0-21swapper/303:08:493
2462199447,31cyclictest0-21swapper/104:57:271
2462199445,33cyclictest0-21swapper/104:16:551
2462199444,35cyclictest0-21swapper/104:48:421
2462199443,36cyclictest0-21swapper/102:58:311
312402433,7sleep30-21swapper/306:09:053
2463699433,35cyclictest0-21swapper/301:43:473
2462999433,33cyclictest0-21swapper/201:03:402
2462199435,6cyclictest0-21swapper/103:19:231
2462199435,6cyclictest0-21swapper/103:19:231
2462199434,33cyclictest0-21swapper/103:39:471
2462199433,35cyclictest0-21swapper/101:18:481
2462199425,31cyclictest0-21swapper/104:38:261
2462199422,35cyclictest15114-21sa101:58:221
115722423,7sleep20-21swapper/201:48:332
294402413,6sleep30-21swapper/304:27:593
236372412,7sleep323717-21ls00:53:503
296282403,6sleep30-21swapper/303:37:363
27142403,6sleep30-21swapper/303:45:173
2463699403,32cyclictest0-21swapper/303:02:453
2462999404,30cyclictest0-21swapper/201:53:462
299942393,7sleep10-21swapper/102:37:011
264952393,6sleep30-21swapper/306:03:303
2463699394,10cyclictest0-21swapper/300:58:333
2463699393,31cyclictest0-21swapper/303:03:453
2463699393,21cyclictest195232sh05:03:223
2463699393,21cyclictest195232sh05:03:223
24629993930,5cyclictest29-21ksoftirqd/202:08:222
24629993930,5cyclictest29-21ksoftirqd/202:08:222
2462199391,33cyclictest26710-21grep06:03:321
164942393,6sleep30-21swapper/301:58:523
102442393,6sleep30-21swapper/303:58:253
72672383,7sleep20-21swapper/201:34:252
318212383,6sleep30-21swapper/302:41:303
2462999384,28cyclictest0-21swapper/201:58:422
2462999381,32cyclictest22610-21sh02:18:202
51732373,7sleep20-21swapper/202:57:422
49202373,6sleep30-21swapper/302:54:383
33352373,6sleep10-21swapper/102:53:071
299632373,7sleep20-21swapper/202:36:382
264262372,6sleep30-21swapper/303:32:213
260012373,6sleep30-21swapper/302:24:033
2463699374,28cyclictest0-21swapper/302:48:453
2463699373,30cyclictest0-21swapper/306:21:153
24636993723,9cyclictest7906-21find04:43:453
2462199373,29cyclictest0-21swapper/106:01:161
2462199372,20cyclictest22682tr01:23:341
303792363,6sleep10-21swapper/101:10:301
2463699364,27cyclictest0-21swapper/303:13:333
2463699364,27cyclictest0-21swapper/303:13:333
24636993625,7cyclictest667-21runrttasks03:54:503
24636993624,8cyclictest25942-21/usr/sbin/munin05:13:503
24636993623,8cyclictest17081-21tail04:58:403
24636993623,8cyclictest17081-21tail04:58:403
24629993624,7cyclictest10397-21tr01:43:442
2400323611,18sleep00-21swapper/000:53:550
222762363,6sleep30-21swapper/302:14:303
56342353,6sleep30-21swapper/305:31:263
2463699354,26cyclictest0-21swapper/301:16:513
2463699354,25cyclictest0-21swapper/304:20:283
2463699354,25cyclictest0-21swapper/304:20:283
2463699354,25cyclictest0-21swapper/302:47:453
2463699353,28cyclictest0-21swapper/303:18:343
2463699353,28cyclictest0-21swapper/303:18:343
2463699352,28cyclictest13531-21/usr/sbin/munin04:03:353
2462999353,27cyclictest0-21swapper/201:38:412
24629993524,7cyclictest2573-21grep01:23:392
24629993524,7cyclictest24055-21grep02:18:532
207182352,6sleep320732-21memory04:13:383
2463699343,27cyclictest0-21swapper/306:27:153
2463699343,27cyclictest0-21swapper/305:55:453
2463699343,27cyclictest0-21swapper/305:55:453
2463699343,27cyclictest0-21swapper/305:40:463
24636993423,7cyclictest4547-21wc03:48:393
2462999344,25cyclictest0-21swapper/202:25:352
2462999344,24cyclictest0-21swapper/201:18:362
24621993421,8cyclictest18102-21awk02:03:481
24621993421,8cyclictest18102-21awk02:03:481
318822333,6sleep10-21swapper/102:42:121
2463699334,25cyclictest0-21swapper/302:28:453
2463699334,25cyclictest0-21swapper/302:08:453
2463699334,25cyclictest0-21swapper/302:08:453
2463699334,24cyclictest0-21swapper/305:33:213
2463699334,24cyclictest0-21swapper/304:34:163
2463699333,26cyclictest0-21swapper/305:10:163
2463699333,26cyclictest0-21swapper/304:53:463
24636993322,7cyclictest814-21ethtool01:18:403
24636993319,9cyclictest1351-21grep05:23:483
24629993321,8cyclictest20221-21grep02:08:532
24629993321,8cyclictest20221-21grep02:08:532
2462199333,25cyclictest0-21swapper/105:05:161
2462199333,25cyclictest0-21swapper/105:05:161
24621993322,7cyclictest8022-21grep01:38:341
112382333,6sleep10-21swapper/101:47:071
2463699324,24cyclictest0-21swapper/304:11:163
2463699324,22cyclictest0-21swapper/303:23:363
2463699323,26cyclictest0-21swapper/304:42:163
2463699323,25cyclictest0-21swapper/301:05:523
2463699323,24cyclictest0-21swapper/301:53:453
187082323,25sleep30-21swapper/305:52:033
152012323,6sleep30-21swapper/305:46:153
129892323,6sleep10-21swapper/101:50:251
2463699314,23cyclictest0-21swapper/304:49:493
2463699314,23cyclictest0-21swapper/301:29:513
2463699314,22cyclictest0-21swapper/306:01:323
2462999314,21cyclictest0-21swapper/201:28:402
2462999313,23cyclictest0-21swapper/202:29:152
2462999313,22cyclictest0-21swapper/202:48:302
24629993121,5cyclictest29-21ksoftirqd/201:13:222
2462199314,23cyclictest0-21swapper/104:00:041
2462199314,21cyclictest0-21swapper/102:13:361
2462199313,20cyclictest0-21swapper/102:08:351
2462199313,20cyclictest0-21swapper/102:08:351
2462199312,25cyclictest27474-21fgrep02:28:491
2463699304,23cyclictest0-21swapper/301:50:263
2463699304,21cyclictest0-21swapper/304:28:433
2463699303,23cyclictest0-21swapper/306:15:153
24636993017,9cyclictest29291-21cut05:18:283
24636993017,8cyclictest31431-21unixbench_singl03:38:523
2462999303,23cyclictest0-21swapper/202:48:202
2462199304,21cyclictest0-21swapper/102:53:341
24636992918,7cyclictest6500-21sort01:33:403
24636992918,6cyclictest22941-21cpu02:18:333
24629992918,7cyclictest30521-21fschecks_count02:38:342
24629992916,8cyclictest31665-21wc01:13:482
2462199294,20cyclictest0-21swapper/102:18:351
2462199293,22cyclictest0-21swapper/101:59:451
2462199293,22cyclictest0-21swapper/101:14:181
2462199293,21cyclictest0-21swapper/102:23:341
24621992919,6cyclictest1151-21ksmtuned02:44:351
2463699283,19cyclictest0-21swapper/301:08:313
24636992818,6cyclictest17207-21/usr/sbin/munin02:03:403
24636992818,6cyclictest17207-21/usr/sbin/munin02:03:403
2462199284,20cyclictest0-21swapper/101:28:501
24621992816,7cyclictest25156-21sort00:58:291
24636992717,6cyclictest7844-21aten_rbpower_cu01:38:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional