You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-09 - 08:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot3.osadl.org (updated Sun Nov 07, 2021 12:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3108699251,0cyclictest23871-21irqstats10:59:394
3108699251,0cyclictest18626-21bash11:47:254
3108699251,0cyclictest10144-21sshd11:31:474
3108699250,0cyclictest24096-21manpath11:58:224
3108699241,0cyclictest7192-21sshd11:26:084
3108699240,0cyclictest21380-21bash11:52:574
3108699240,0cyclictest1457-21grep07:34:444
3110399235,0cyclictest24180-21ntp_kernel_pll_10:59:427
3108699231,0cyclictest13527-21sshd11:38:484
3108699231,0cyclictest0-21swapper/411:10:494
3108699231,0cyclictest0-21swapper/411:04:384
3108699230,0cyclictest9849-21scp12:31:344
3108699230,0cyclictest9849-21scp12:31:344
3108699230,0cyclictest5459-21sshd12:24:404
3108699230,0cyclictest27332-21sshd12:04:324
3108699230,0cyclictest2555-21sshd11:19:454
3108699230,0cyclictest16602-21sshd12:44:474
3108699230,0cyclictest16602-21sshd12:44:474
3108699230,0cyclictest14016-21sshd11:39:374
3108699230,0cyclictest0-21swapper/410:49:384
3108699230,0cyclictest0-21swapper/408:44:414
92550220,0irq/32-eth0-TxR0-21swapper/312:39:423
92450220,0irq/31-eth0-TxR0-21swapper/212:29:362
92450220,0irq/31-eth0-TxR0-21swapper/212:29:362
92250220,0irq/29-eth0-TxR0-21swapper/012:01:190
3108699221,0cyclictest8868-21latency_hist10:29:204
3108699221,0cyclictest25551-21sed09:49:384
3108699221,0cyclictest15686-21timerandwakeup09:24:474
3108699221,0cyclictest13520-21sed10:39:354
3108699221,0cyclictest10275-21latency_hist09:14:214
3108699220,0cyclictest451-21sshd12:14:464
3108699220,0cyclictest30005-21scp12:09:474
3108699220,0cyclictest24613-21sshd11:59:344
3108699220,0cyclictest22140-21bash10:55:584
3108699220,0cyclictest0-21swapper/412:39:364
3108699220,0cyclictest0-21swapper/411:14:464
3108699220,0cyclictest0-21swapper/410:44:464
3108699220,0cyclictest0-21swapper/410:14:444
3108699220,0cyclictest0-21swapper/408:34:204
3108699220,0cyclictest0-21swapper/407:45:094
3108699220,0cyclictest0-21swapper/407:29:384
92450210,0irq/31-eth0-TxR5459-21sshd12:24:372
92450210,0irq/31-eth0-TxR0-21swapper/212:44:392
92450210,0irq/31-eth0-TxR0-21swapper/212:44:392
92450210,0irq/31-eth0-TxR0-21swapper/211:54:422
92450210,0irq/31-eth0-TxR0-21swapper/211:38:052
92450210,0irq/31-eth0-TxR0-21swapper/211:04:452
92450210,0irq/31-eth0-TxR0-21swapper/210:54:492
92350210,0irq/30-eth0-TxR0-21swapper/112:34:441
92350210,0irq/30-eth0-TxR0-21swapper/112:10:411
92250210,0irq/29-eth0-TxR0-21swapper/010:50:320
3110399215,0cyclictest28339-21df_abs08:39:427
3110399214,0cyclictest844-21nscd08:44:367
3110399214,0cyclictest17920-21fschecks_time10:49:407
3108699211,0cyclictest20881-21cpu09:39:374
3108699211,0cyclictest11269-21cat07:59:204
3108699211,0cyclictest0-21swapper/410:34:444
3108699211,0cyclictest0-21swapper/410:34:444
3108699210,0cyclictest7430-21wget07:49:384
3108699210,0cyclictest23944-21ls09:44:474
3108699210,0cyclictest20799-21scp12:50:444
3108699210,0cyclictest10338-21sshd12:34:214
3108699210,0cyclictest0-21swapper/412:54:454
3108699210,0cyclictest0-21swapper/412:19:384
3108699210,0cyclictest0-21swapper/410:29:444
3108699210,0cyclictest0-21swapper/410:09:454
3108699210,0cyclictest0-21swapper/409:34:424
3108699210,0cyclictest0-21swapper/409:19:444
3108699210,0cyclictest0-21swapper/409:09:344
3108699210,0cyclictest0-21swapper/409:04:484
3108699210,0cyclictest0-21swapper/408:39:424
3108699210,0cyclictest0-21swapper/408:24:484
3108699210,0cyclictest0-21swapper/408:19:344
3108699210,0cyclictest0-21swapper/408:19:204
3108699210,0cyclictest0-21swapper/408:04:474
3108699210,0cyclictest0-21swapper/408:04:474
3108699210,0cyclictest0-21swapper/407:39:484
92550200,0irq/32-eth0-TxR836-21missed_timers12:14:403
92550200,0irq/32-eth0-TxR0-21swapper/310:54:383
92450200,0irq/31-eth0-TxR30905-21sshd11:11:172
92450200,0irq/31-eth0-TxR0-21swapper/211:29:342
92450200,0irq/31-eth0-TxR0-21swapper/211:22:522
92350200,0irq/30-eth0-TxR0-21swapper/112:00:351
92250200,0irq/29-eth0-TxR21554-21sshd11:53:560
92250200,0irq/29-eth0-TxR0-21swapper/011:29:440
92250200,0irq/29-eth0-TxR0-21swapper/011:05:070
381200,0rcuc/34818-21scp11:23:293
3110399206,0cyclictest21819-21switchtime09:39:487
3110399204,0cyclictest834-21nscd08:49:537
3110399204,0cyclictest4096-21systemd-cgroups11:20:147
3110399204,0cyclictest23597-21netstat09:44:417
3108699201,0cyclictest29819-21ls09:59:494
3108699200,0cyclictest31271-21wget10:04:394
3108699200,0cyclictest2165-21sed08:54:384
3108699200,0cyclictest0-21swapper/410:19:334
3108699200,0cyclictest0-21swapper/410:19:334
3108699200,0cyclictest0-21swapper/409:54:354
3108699200,0cyclictest0-21swapper/409:29:354
3108699200,0cyclictest0-21swapper/408:49:524
3108699200,0cyclictest0-21swapper/408:29:544
3108699200,0cyclictest0-21swapper/408:09:484
3108699200,0cyclictest0-21swapper/407:59:354
92550190,0irq/32-eth0-TxR0-21swapper/311:59:433
92550190,0irq/32-eth0-TxR0-21swapper/311:43:143
92550190,0irq/32-eth0-TxR0-21swapper/311:10:493
92350190,0irq/30-eth0-TxR0-21swapper/112:23:141
92350190,0irq/30-eth0-TxR0-21swapper/111:30:091
92350190,0irq/30-eth0-TxR0-21swapper/111:09:391
92250190,0irq/29-eth0-TxR3942-21switchtime12:19:430
92250190,0irq/29-eth0-TxR0-21swapper/012:46:200
92250190,0irq/29-eth0-TxR0-21swapper/012:46:200
541190,0rcuc/50-21swapper/510:52:265
3110399196,0cyclictest23768-21bash11:56:387
3110399195,0cyclictest2594-21latency08:54:427
3110399195,0cyclictest1629-21latency07:34:467
3110399194,0cyclictest16210-21netstat10:44:407
3110399193,0cyclictest4898-21date07:44:207
3110399191,0cyclictest30642-21systemd11:10:067
3110399191,0cyclictest0-21swapper/712:24:347
3108699191,0cyclictest4602-21kernelversion08:59:414
3108699191,0cyclictest4602-21kernelversion08:59:414
92550180,0irq/32-eth0-TxR5489-21/usr/sbin/munin12:24:433
92550180,0irq/32-eth0-TxR10604-21scp11:34:083
92550180,0irq/32-eth0-TxR0-21swapper/311:52:403
92550180,0irq/32-eth0-TxR0-21swapper/311:44:203
92550180,0irq/32-eth0-TxR0-21swapper/311:34:223
92450180,0irq/31-eth0-TxR28398-21sed12:04:432
92450180,0irq/31-eth0-TxR19583-21df_abs11:49:362
92450180,0irq/31-eth0-TxR0-21swapper/211:29:202
92350180,0irq/30-eth0-TxR11162-21rpm11:34:231
92350180,0irq/30-eth0-TxR0-21swapper/111:52:421
92350180,0irq/30-eth0-TxR0-21swapper/111:44:371
92350180,0irq/30-eth0-TxR0-21swapper/111:14:381
92350180,0irq/30-eth0-TxR0-21swapper/110:51:141
92250180,0irq/29-eth0-TxR12510-21timerandwakeup12:34:460
92250180,0irq/29-eth0-TxR0-21swapper/011:19:030
701180,0rcuc/70-21swapper/710:39:357
621180,0rcuc/60-21swapper/611:09:386
621180,0rcuc/60-21swapper/607:24:346
541180,0rcuc/50-21swapper/507:39:575
3110399185,0cyclictest18653-21readlink11:47:397
3108699180,0cyclictest31155-21sed07:29:204
221180,0rcuc/10-21swapper/110:44:361
14150180,0irq/14-ahci[e0325868-21touch11:04:200
14150180,0irq/14-ahci[e030-21swapper/009:04:200
14150180,0irq/14-ahci[e030-21swapper/009:04:200
111180,0rcu_preempt24-21ksoftirqd/111:02:311
92550170,0irq/32-eth0-TxR19079-21sshd10:50:293
92550170,0irq/32-eth0-TxR0-21swapper/312:49:583
92550170,0irq/32-eth0-TxR0-21swapper/312:36:023
92450170,0irq/31-eth0-TxR451-21sshd12:14:442
92450170,0irq/31-eth0-TxR13817-21latency_hist12:39:202
92450170,0irq/31-eth0-TxR0-21swapper/212:21:452
92450170,0irq/31-eth0-TxR0-21swapper/212:09:212
92450170,0irq/31-eth0-TxR0-21swapper/211:59:522
92350170,0irq/30-eth0-TxR0-21swapper/112:49:361
92250170,0irq/29-eth0-TxR2619-21wget11:19:350
92250170,0irq/29-eth0-TxR16809-21wget11:44:340
92250170,0irq/29-eth0-TxR0-21swapper/012:11:520
92250170,0irq/29-eth0-TxR0-21swapper/011:54:210
92250170,0irq/29-eth0-TxR0-21swapper/011:34:460
92250170,0irq/29-eth0-TxR0-21swapper/010:59:150
621170,0rcuc/60-21swapper/611:54:366
621170,0rcuc/60-21swapper/611:42:466
541170,0rcuc/50-21swapper/512:40:035
541170,0rcuc/50-21swapper/512:29:365
541170,0rcuc/50-21swapper/512:29:365
541170,0rcuc/50-21swapper/510:19:445
541170,0rcuc/50-21swapper/510:19:445
541170,0rcuc/50-21swapper/508:40:005
381170,0rcuc/30-21swapper/311:54:403
381170,0rcuc/30-21swapper/308:39:523
3110399175,0cyclictest4457-21sh08:59:397
3110399175,0cyclictest4457-21sh08:59:397
3110399175,0cyclictest26615-21bash12:02:477
3110399175,0cyclictest20362-21latency_hist09:39:207
3110399174,0cyclictest561-21wc11:14:437
3110399172,0cyclictest0-21swapper/711:08:267
3110399171,0cyclictest0-21swapper/709:29:207
301170,0rcuc/20-21swapper/211:39:452
221170,0rcuc/10-21swapper/112:29:401
221170,0rcuc/10-21swapper/112:29:401
221170,0rcuc/10-21swapper/112:14:381
2099170,0migration/122083-21bash10:55:441
14150170,0irq/14-ahci[e030-21swapper/012:29:210
96450160,0irq/34-eth1-TxR11330-21wget10:34:330
96450160,0irq/34-eth1-TxR11330-21wget10:34:330
92550160,0irq/32-eth0-TxR26046-21sed11:04:213
92550160,0irq/32-eth0-TxR1126-21scp11:15:023
92550160,0irq/32-eth0-TxR10027-21sshd12:32:373
92550160,0irq/32-eth0-TxR10027-21sshd12:32:373
92550160,0irq/32-eth0-TxR0-21swapper/311:24:363
92450160,0irq/31-eth0-TxR24841-21sshd11:00:122
92450160,0irq/31-eth0-TxR0-21swapper/212:35:022
92350160,0irq/30-eth0-TxR3677-21/usr/sbin/munin11:19:471
92350160,0irq/30-eth0-TxR29333-21chrt12:08:041
92350160,0irq/30-eth0-TxR0-21swapper/112:39:471
92250160,0irq/29-eth0-TxR1821-21sshd12:16:060
92250160,0irq/29-eth0-TxR0-21swapper/012:29:390
92250160,0irq/29-eth0-TxR0-21swapper/012:29:390
92250160,0irq/29-eth0-TxR0-21swapper/012:05:310
92250160,0irq/29-eth0-TxR0-21swapper/011:12:130
701160,0rcuc/70-21swapper/712:54:427
701160,0rcuc/70-21swapper/712:41:437
701160,0rcuc/70-21swapper/712:06:447
701160,0rcuc/70-21swapper/711:43:147
701160,0rcuc/70-21swapper/710:09:207
701160,0rcuc/70-21swapper/708:34:517
701160,0rcuc/70-21swapper/708:24:407
701160,0rcuc/70-21swapper/708:14:207
621160,0rcuc/60-21swapper/611:36:426
621160,0rcuc/60-21swapper/611:04:386
621160,0rcuc/60-21swapper/608:09:546
621160,0rcuc/60-21swapper/607:29:466
541160,0rcuc/513276-21sshd12:37:485
541160,0rcuc/50-21swapper/512:11:535
541160,0rcuc/50-21swapper/512:06:155
541160,0rcuc/50-21swapper/511:57:015
541160,0rcuc/50-21swapper/511:34:365
541160,0rcuc/50-21swapper/511:23:175
541160,0rcuc/50-21swapper/511:16:145
541160,0rcuc/50-21swapper/511:04:365
541160,0rcuc/50-21swapper/511:03:005
541160,0rcuc/50-21swapper/510:54:365
541160,0rcuc/50-21swapper/510:34:335
541160,0rcuc/50-21swapper/510:34:335
541160,0rcuc/50-21swapper/509:14:455
541160,0rcuc/50-21swapper/508:24:395
541160,0rcuc/50-21swapper/507:34:475
541160,0rcuc/50-21swapper/507:29:395
381160,0rcuc/319967-21df_abs08:19:343
381160,0rcuc/30-21swapper/310:19:313
381160,0rcuc/30-21swapper/310:19:313
381160,0rcuc/30-21swapper/309:34:423
381160,0rcuc/30-21swapper/308:59:463
381160,0rcuc/30-21swapper/308:59:463
381160,0rcuc/30-21swapper/308:04:543
381160,0rcuc/30-21swapper/308:04:543
3110399164,0cyclictest32608-21aten_rapower_cu12:14:337
3110399160,0cyclictest0-21swapper/709:49:357
301160,0rcuc/20-21swapper/212:49:472
301160,0rcuc/20-21swapper/211:17:102
301160,0rcuc/20-21swapper/209:24:452
301160,0rcuc/20-21swapper/207:24:522
221160,0rcuc/10-21swapper/112:48:461
221160,0rcuc/10-21swapper/112:48:461
221160,0rcuc/10-21swapper/111:57:221
221160,0rcuc/10-21swapper/109:59:411
221160,0rcuc/10-21swapper/108:39:511
221160,0rcuc/10-21swapper/108:24:421
221160,0rcuc/10-21swapper/108:19:381
221160,0rcuc/10-21swapper/107:29:461
14150160,0irq/14-ahci[e030-21swapper/010:29:200
141160,0rcuc/00-21swapper/010:29:380
96750150,0irq/37-eth1-TxR0-21swapper/308:44:403
96450150,0irq/34-eth1-TxR20658-21timerwakeupswit12:49:480
92550150,0irq/32-eth0-TxR0-21swapper/312:19:593
92550150,0irq/32-eth0-TxR0-21swapper/312:05:453
92550150,0irq/32-eth0-TxR0-21swapper/311:04:213
92350150,0irq/30-eth0-TxR0-21swapper/111:27:051
92250150,0irq/29-eth0-TxR16025-21sshd12:43:230
92250150,0irq/29-eth0-TxR0-21swapper/011:39:440
92250150,0irq/29-eth0-TxR0-21swapper/011:27:500
701150,0rcuc/70-21swapper/712:35:147
701150,0rcuc/70-21swapper/712:20:457
701150,0rcuc/70-21swapper/712:14:217
701150,0rcuc/70-21swapper/711:49:377
701150,0rcuc/70-21swapper/710:54:347
701150,0rcuc/70-21swapper/710:34:367
701150,0rcuc/70-21swapper/710:34:367
701150,0rcuc/70-21swapper/710:19:347
701150,0rcuc/70-21swapper/710:19:347
701150,0rcuc/70-21swapper/710:14:357
701150,0rcuc/70-21swapper/709:14:477
701150,0rcuc/70-21swapper/708:04:497
701150,0rcuc/70-21swapper/708:04:497
701150,0rcuc/70-21swapper/707:29:397
621150,0rcuc/610488-21bash11:33:256
621150,0rcuc/60-21swapper/612:54:336
621150,0rcuc/60-21swapper/612:42:396
621150,0rcuc/60-21swapper/612:34:426
621150,0rcuc/60-21swapper/612:19:416
621150,0rcuc/60-21swapper/611:45:106
621150,0rcuc/60-21swapper/611:14:366
621150,0rcuc/60-21swapper/610:54:346
621150,0rcuc/60-21swapper/610:50:186
621150,0rcuc/60-21swapper/610:39:376
621150,0rcuc/60-21swapper/609:19:386
541150,0rcuc/59211-21wget10:29:355
541150,0rcuc/50-21swapper/512:54:375
541150,0rcuc/50-21swapper/512:49:375
541150,0rcuc/50-21swapper/512:24:355
541150,0rcuc/50-21swapper/512:21:005
541150,0rcuc/50-21swapper/512:17:345
541150,0rcuc/50-21swapper/511:50:595
541150,0rcuc/50-21swapper/511:44:475
541150,0rcuc/50-21swapper/511:29:345
541150,0rcuc/50-21swapper/511:25:115
541150,0rcuc/50-21swapper/511:14:195
541150,0rcuc/50-21swapper/510:44:465
541150,0rcuc/50-21swapper/510:39:395
541150,0rcuc/50-21swapper/509:34:485
541150,0rcuc/50-21swapper/509:24:465
541150,0rcuc/50-21swapper/509:09:485
541150,0rcuc/50-21swapper/508:30:055
541150,0rcuc/50-21swapper/508:19:465
541150,0rcuc/50-21swapper/508:14:315
541150,0rcuc/50-21swapper/507:49:505
381150,0rcuc/30-21swapper/312:46:043
381150,0rcuc/30-21swapper/312:46:043
381150,0rcuc/30-21swapper/310:39:433
381150,0rcuc/30-21swapper/310:34:363
381150,0rcuc/30-21swapper/310:34:363
381150,0rcuc/30-21swapper/309:44:353
381150,0rcuc/30-21swapper/308:09:493
381150,0rcuc/30-21swapper/307:44:583
381150,0rcuc/30-21swapper/307:34:403
301150,0rcuc/20-21swapper/210:49:462
301150,0rcuc/20-21swapper/209:49:422
301150,0rcuc/20-21swapper/209:44:352
301150,0rcuc/20-21swapper/208:29:462
301150,0rcuc/20-21swapper/207:44:482
301150,0rcuc/20-21swapper/207:34:432
221150,0rcuc/16795-21latency_hist10:24:201
221150,0rcuc/16795-21latency_hist10:24:201
221150,0rcuc/10-21swapper/112:24:381
221150,0rcuc/10-21swapper/111:04:381
221150,0rcuc/10-21swapper/110:29:351
221150,0rcuc/10-21swapper/109:24:461
221150,0rcuc/10-21swapper/107:49:511
14150150,0irq/14-ahci[e030-21swapper/010:19:200
141150,0rcuc/00-21swapper/012:54:330
141150,0rcuc/00-21swapper/008:14:300
111150,0rcu_preempt56-21ksoftirqd/507:49:195
111150,0rcu_preempt24-21ksoftirqd/109:54:431
111150,0rcu_preempt18822-21sshd11:48:402
96650140,0irq/36-eth1-TxR0-21swapper/209:34:362
701140,0rcuc/70-21swapper/712:49:437
701140,0rcuc/70-21swapper/712:46:447
701140,0rcuc/70-21swapper/712:46:447
701140,0rcuc/70-21swapper/711:37:527
701140,0rcuc/70-21swapper/711:29:467
701140,0rcuc/70-21swapper/711:24:357
701140,0rcuc/70-21swapper/709:59:547
701140,0rcuc/70-21swapper/709:54:217
701140,0rcuc/70-21swapper/709:24:397
701140,0rcuc/70-21swapper/708:30:077
701140,0rcuc/70-21swapper/708:19:327
701140,0rcuc/70-21swapper/707:59:387
701140,0rcuc/70-21swapper/707:54:537
701140,0rcuc/70-21swapper/707:49:397
701140,0rcuc/70-21swapper/707:44:507
701140,0rcuc/70-21swapper/707:24:347
631140,0ktimersoftd/60-21swapper/609:59:396
621140,0rcuc/60-21swapper/612:49:476
621140,0rcuc/60-21swapper/612:44:386
621140,0rcuc/60-21swapper/612:44:386
621140,0rcuc/60-21swapper/612:31:196
621140,0rcuc/60-21swapper/612:31:196
621140,0rcuc/60-21swapper/612:24:336
621140,0rcuc/60-21swapper/612:09:566
621140,0rcuc/60-21swapper/611:49:346
621140,0rcuc/60-21swapper/611:28:516
621140,0rcuc/60-21swapper/610:59:396
621140,0rcuc/60-21swapper/610:44:396
621140,0rcuc/60-21swapper/608:19:366
621140,0rcuc/60-21swapper/608:14:316
621140,0rcuc/60-21swapper/608:04:566
621140,0rcuc/60-21swapper/608:04:566
621140,0rcuc/60-21swapper/607:49:536
621140,0rcuc/60-21swapper/607:44:566
621140,0rcuc/60-21swapper/607:39:576
541140,0rcuc/517049-21interrupts09:29:395
541140,0rcuc/516076-21bash11:42:595
541140,0rcuc/50-21swapper/512:44:395
541140,0rcuc/50-21swapper/512:44:395
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional