You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 03:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Thu Apr 18, 2024 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306878399257,10cyclictest3164117-21basename08:40:012
3068778992522,2cyclictest3399372-21munin-run11:25:001
3068775992418,5cyclictest516-21rs:main0
3068785992317,1cyclictest191rcu_preempt11:25:193
3068778992320,2cyclictest3179845-21https08:55:011
3068785992217,3cyclictest3339641-21irqcore10:45:163
306878399223,12cyclictest3090224-21idleruntime-cro07:30:012
3068785992117,1cyclictest191rcu_preempt12:21:293
3068785992115,4cyclictest3218597-21sh09:25:013
3068785992115,1cyclictest191rcu_preempt09:51:453
3068785992112,4cyclictest0-21swapper/311:00:183
3068785992112,4cyclictest0-21swapper/311:00:173
3068778992118,2cyclictest0-21swapper/112:05:001
3068778992116,4cyclictest3421814-21cron11:40:001
3068775992118,2cyclictest3481927-21cron12:20:000
3068775992117,2cyclictest3485221-21kthreadcore12:20:220
3068775992110,10cyclictest3406850-21idleruntime-cro11:30:000
3068785992019,1cyclictest0-21swapper/307:39:553
3068785992016,2cyclictest3190783-21idleruntime-cro09:05:003
3068785992014,1cyclictest191rcu_preempt12:05:173
3068785992012,2cyclictest0-21swapper/309:10:013
3068785992010,1cyclictest191rcu_preempt10:02:363
3068783992017,2cyclictest3286891-21gltestperf10:10:172
306877899208,4cyclictest3225403-21kworker/u8:3+xprtiod11:55:451
3068775992016,2cyclictest0-21swapper/009:54:590
306878599199,4cyclictest0-21swapper/311:50:173
306878599197,1cyclictest191rcu_preempt11:32:003
306878599192,4cyclictest3302654-21sed10:20:183
3068785991916,2cyclictest3280166-21kthreadcore10:05:163
3068785991915,1cyclictest191rcu_preempt12:30:183
3068785991915,1cyclictest191rcu_preempt10:59:213
3068785991910,4cyclictest0-21swapper/309:29:073
306878399192,8cyclictest3105991-21munin-run07:45:012
3068783991916,2cyclictest3506016-21fschecks_time12:35:162
3068783991915,3cyclictest3241744-21fschecks_count09:40:132
306877899190,9cyclictest3293682-21awk10:15:001
3068775991916,2cyclictest3504934-21apt-get12:34:590
306878599189,6cyclictest0-21swapper/309:18:133
306878599189,5cyclictest0-21swapper/312:00:183
306878599189,2cyclictest3424674-21kthreadcore11:40:183
306878599189,1cyclictest0-21swapper/308:50:183
306878599185,4cyclictest3244959-21tr09:40:183
306878599182,3cyclictest0-21swapper/309:58:533
3068785991816,1cyclictest3068770-21cyclictest08:35:233
3068785991813,1cyclictest191rcu_preempt11:10:333
3068785991813,1cyclictest191rcu_preempt09:12:133
3068785991813,1cyclictest191rcu_preempt07:28:423
3068785991812,1cyclictest191rcu_preempt10:10:253
3068785991811,1cyclictest191rcu_preempt11:58:453
3068785991810,4cyclictest0-21swapper/307:55:163
3068783991816,1cyclictest3415256-21grep11:35:192
3068778991815,2cyclictest3364554-21tr11:00:191
3068778991815,2cyclictest3364554-21tr11:00:181
3068778991815,2cyclictest3286159-21ssh10:10:001
3068778991814,2cyclictest3433898-21needreboot11:45:211
306877899180,4cyclictest3422718-21grep11:40:171
3068775991815,2cyclictest2955-21cron08:40:000
3068775991814,2cyclictest60650irq/128-enp0s29f1:rx-010:34:590
3068775991813,4cyclictest61450irq/129-enp0s29f1:tx-011:55:190
3068775991812,2cyclictest60650irq/128-enp0s29f1:rx-010:16:580
306878599179,1cyclictest191rcu_preempt10:39:123
306878599178,5cyclictest0-21swapper/311:45:203
306878599178,4cyclictest0-21swapper/312:13:103
306878599178,4cyclictest0-21swapper/310:26:013
306878599178,1cyclictest191rcu_preempt11:21:393
306878599177,1cyclictest191rcu_preempt09:33:143
306878599176,6cyclictest0-21swapper/308:15:103
306878599176,6cyclictest0-21swapper/308:15:103
306878599174,3cyclictest0-21swapper/307:33:383
306878599173,3cyclictest0-21swapper/311:18:373
306878599172,4cyclictest3331519-21/usr/sbin/munin10:40:253
306878599171,9cyclictest50-21ksoftirqd/310:50:093
3068785991712,1cyclictest191rcu_preempt10:34:123
3068785991711,1cyclictest191rcu_preempt09:46:003
3068785991710,1cyclictest191rcu_preempt09:35:353
306878399179,7cyclictest3218592-21cron09:25:012
306878399178,2cyclictest3278698-21idleruntime-cro10:04:592
306878399178,2cyclictest0-21swapper/209:50:162
306878399174,6cyclictest3311492-21kthreadcore10:25:192
306878399172,1cyclictest191rcu_preempt11:05:012
306878399172,1cyclictest191rcu_preempt11:05:002
3068783991714,2cyclictest401ktimers/212:29:542
3068783991714,2cyclictest3175344-21irqcore08:50:182
3068783991714,2cyclictest0-21swapper/211:32:522
3068778991714,2cyclictest3211123-21latency_hist09:20:001
3068778991714,2cyclictest3126951-21cut08:05:001
3068778991714,2cyclictest3121711-21cron08:00:001
3068778991713,3cyclictest3132926-21cpuspeed_turbos08:10:131
3068775991714,2cyclictest60650irq/128-enp0s29f1:rx-012:08:570
3068775991714,2cyclictest60650irq/128-enp0s29f1:rx-011:15:170
3068775991714,2cyclictest60650irq/128-enp0s29f1:rx-011:09:350
3068775991714,2cyclictest60650irq/128-enp0s29f1:rx-009:34:270
3068775991714,2cyclictest60650irq/128-enp0s29f1:rx-009:20:190
3068775991714,2cyclictest60650irq/128-enp0s29f1:rx-009:16:480
3068775991714,2cyclictest3111635-21cpuspeed_turbos07:50:110
3068775991713,3cyclictest60650irq/128-enp0s29f1:rx-009:10:110
3068775991713,3cyclictest60650irq/128-enp0s29f1:rx-008:25:250
3068775991713,3cyclictest3248674-21turbostat09:45:000
3068775991711,4cyclictest260-21systemd-journal10:30:000
3068775991711,2cyclictest60650irq/128-enp0s29f1:rx-009:55:220
3068775991711,2cyclictest60650irq/128-enp0s29f1:rx-009:35:230
306878599168,1cyclictest191rcu_preempt12:25:353
306878599167,4cyclictest0-21swapper/307:44:393
306878599166,4cyclictest0-21swapper/311:09:003
306878599163,3cyclictest50-21ksoftirqd/308:00:173
306878599162,5cyclictest50-21ksoftirqd/312:35:323
3068785991614,1cyclictest3146417-21kthreadcore08:20:203
3068785991614,1cyclictest0-21swapper/307:50:163
3068785991614,1cyclictest0-21swapper/307:15:003
306878599160,4cyclictest3294025-21ssh10:15:113
306878599160,4cyclictest3196050-21diskmemload11:36:583
306878399167,1cyclictest3384273-21ssh11:14:592
3068783991614,1cyclictest3203571-21cron09:15:002
3068783991613,2cyclictest3169324-21cron08:45:002
3068783991613,2cyclictest0-21swapper/212:35:002
3068783991612,2cyclictest0-21swapper/212:05:252
306877899166,2cyclictest191rcu_preempt09:50:181
306877899164,4cyclictest3376781-21kworker/u8:4+xprtiod11:13:431
3068778991613,2cyclictest355-21hwrng10:49:301
3068778991610,4cyclictest260-21systemd-journal10:34:591
3068775991614,1cyclictest60650irq/128-enp0s29f1:rx-011:50:060
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-012:35:150
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-012:04:220
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-011:35:140
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-011:30:140
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-011:00:060
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-011:00:060
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-010:59:470
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-010:47:000
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-010:21:260
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-010:00:220
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-009:46:480
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-008:50:390
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-008:23:090
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-007:41:370
3068775991613,2cyclictest60650irq/128-enp0s29f1:rx-007:15:540
3068775991613,2cyclictest3180884-21cut08:55:130
3068775991612,3cyclictest60650irq/128-enp0s29f1:rx-012:13:270
3068775991612,3cyclictest3328224-21cut10:35:230
3068775991612,2cyclictest60650irq/128-enp0s29f1:rx-010:50:070
3068775991612,1cyclictest60650irq/128-enp0s29f1:rx-011:22:040
306878599159,4cyclictest3185444-21sshd08:59:333
306878599159,1cyclictest191rcu_preempt08:45:193
306878599157,4cyclictest0-21swapper/308:25:163
3068785991512,2cyclictest481rcuc/308:10:173
3068785991511,1cyclictest191rcu_preempt08:05:103
3068785991511,1cyclictest191rcu_preempt07:45:233
306878599150,5cyclictest3077498-21cut07:15:193
306878599150,4cyclictest3081958-21kthreadcore07:20:183
306878399153,2cyclictest3158371-21unixbench_multi08:30:242
3068783991513,1cyclictest3469633-21kthreadcore12:10:192
3068783991513,1cyclictest3454403-21kthreadcore12:00:182
3068783991513,1cyclictest3437300-21tr11:50:112
3068783991512,2cyclictest3332079-21irqcore10:40:172
3068783991512,2cyclictest3264889-21irqcore09:55:172
3068783991512,2cyclictest3231191-21unixbench_multi09:30:272
3068783991511,3cyclictest3324101-21cpuspeed_turbos10:35:152
3068783991511,3cyclictest3316471-21/usr/sbin/munin10:30:232
3068783991511,2cyclictest0-21swapper/212:20:172
3068783991511,2cyclictest0-21swapper/209:30:002
306877899156,1cyclictest191rcu_preempt09:30:051
306877899155,2cyclictest191rcu_preempt09:13:141
306877899155,1cyclictest191rcu_preempt12:33:431
3068778991512,2cyclictest311ktimers/111:17:101
3068778991512,2cyclictest311ktimers/110:43:501
3068778991512,1cyclictest0-21swapper/107:45:171
3068778991511,2cyclictest0-21swapper/109:25:211
3068775991513,1cyclictest60650irq/128-enp0s29f1:rx-011:45:130
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-011:42:020
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-010:40:030
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-010:10:210
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-009:25:130
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-009:01:300
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-008:07:520
3068775991512,2cyclictest60650irq/128-enp0s29f1:rx-007:25:240
3068775991511,3cyclictest60650irq/128-enp0s29f1:rx-011:10:100
3068775991511,3cyclictest60650irq/128-enp0s29f1:rx-008:45:140
306878599145,1cyclictest0-21swapper/308:30:183
306878599140,3cyclictest3164772-21idleruntime08:40:163
306878399149,4cyclictest0-21swapper/208:25:192
306878399148,5cyclictest3445312-21seq11:55:172
306878399145,2cyclictest0-21swapper/211:20:142
3068783991412,1cyclictest3125995-21cut08:00:192
3068783991412,1cyclictest0-21swapper/207:45:162
3068783991411,2cyclictest3399994-21fschecks_time11:25:142
3068783991411,2cyclictest3385185-21sed11:15:192
3068783991411,2cyclictest3249561-21sed09:45:152
3068783991411,2cyclictest3195122-21needreboot09:05:232
3068783991411,2cyclictest3169669-21cpuspeed_turbos08:45:142
3068783991411,2cyclictest3098222-21kthreadcore07:35:212
3068783991411,2cyclictest0-21swapper/211:50:012
3068783991411,2cyclictest0-21swapper/211:40:112
3068783991410,3cyclictest3358767-21grep10:55:272
306877899144,2cyclictest191rcu_preempt11:33:531
306877899143,2cyclictest191rcu_preempt12:18:061
306877899143,2cyclictest191rcu_preempt11:55:011
3068778991412,1cyclictest0-21swapper/108:30:141
3068778991411,2cyclictest355-21hwrng12:05:171
3068778991411,2cyclictest3406871-21idleruntime-cro11:30:001
3068778991411,2cyclictest3324347-21gltestperf10:35:181
3068778991411,2cyclictest3255456-21kworker/u8:2+xprtiod10:15:361
3068778991410,3cyclictest3361352-21unin-run11:00:011
3068778991410,3cyclictest0-21swapper/112:30:011
306877899140,3cyclictest512-21tpm2-abrmd09:25:011
306877899140,3cyclictest3309159-21expr10:25:121
306877899140,2cyclictest3241520-21apt-get09:40:121
306877599141,4cyclictest3084535-21awk07:25:000
3068775991411,2cyclictest60650irq/128-enp0s29f1:rx-007:37:310
3068775991410,3cyclictest3164870-21irqcore08:40:170
306878399139,3cyclictest3138285-21fschecks_count08:15:112
306878399139,3cyclictest3138285-21fschecks_count08:15:112
306878399136,6cyclictest3120763-21cut07:55:202
306878399133,2cyclictest191rcu_preempt07:15:252
3068783991311,1cyclictest3278998-21/usr/sbin/munin10:05:162
3068783991311,1cyclictest0-21swapper/207:15:002
3068783991310,2cyclictest401ktimers/209:15:122
3068783991310,2cyclictest3185739-21/usr/sbin/munin09:00:162
3068783991310,2cyclictest3127917-21gltestperf08:05:142
306878399130,4cyclictest3369724-21tr11:05:122
306877899139,3cyclictest3275349-21kthreadcore10:00:231
306877899139,3cyclictest311ktimers/109:55:251
306877899138,4cyclictest3143847-21irqcore08:20:181
3068778991311,1cyclictest0-21swapper/109:45:171
3068778991310,2cyclictest3483277-21sed12:20:201
3068778991310,2cyclictest311ktimers/111:05:121
3068778991310,2cyclictest3099786-21needreboot07:35:221
3068778991310,2cyclictest3084551-21cut07:25:001
3068778991310,2cyclictest3076707-21tr07:15:191
3068778991310,2cyclictest3069056-21cpuspeed_turbos07:10:121
3068778991310,2cyclictest0-21swapper/112:35:001
3068778991310,2cyclictest0-21swapper/107:30:001
3068775991311,2cyclictest60650irq/128-enp0s29f1:rx-009:05:170
3068775991311,2cyclictest60650irq/128-enp0s29f1:rx-008:12:440
3068775991310,2cyclictest60650irq/128-enp0s29f1:rx-008:19:280
3068775991310,2cyclictest60650irq/128-enp0s29f1:rx-008:19:280
306878399129,2cyclictest3342532-21kthreadcore10:45:182
306878399128,2cyclictest0-21swapper/210:50:192
306878399127,3cyclictest3238863-21sshd09:35:402
306878399126,4cyclictest3133154-21grep08:10:152
306878399125,1cyclictest191rcu_preempt07:25:002
306878399124,2cyclictest191rcu_preempt12:15:132
306878399122,2cyclictest191rcu_preempt10:15:192
3068783991210,1cyclictest3143678-21gltestperf08:20:162
306878399120,5cyclictest191rcu_preempt09:00:002
306877899129,2cyclictest3090594-21cpuspeed_turbos07:30:101
3068778991210,1cyclictest3185987-21fschecks_time09:00:131
3068778991210,1cyclictest0-21swapper/108:25:211
306877899120,4cyclictest3116481-21latency_hist07:55:001
306877899120,3cyclictest3306423-21ssh10:20:441
306877899120,3cyclictest3180819-21grep08:55:131
306877899120,3cyclictest0-21swapper/108:40:201
306877599129,2cyclictest60650irq/128-enp0s29f1:rx-007:58:590
306877599129,2cyclictest60650irq/128-enp0s29f1:rx-007:45:120
306877599129,2cyclictest60650irq/128-enp0s29f1:rx-007:30:120
306878399118,2cyclictest3111996-21irqcore07:50:162
306878399117,3cyclictest401ktimers/210:20:092
306877899118,2cyclictest3104836-21kthreadcore07:40:181
306877899117,2cyclictest0-21swapper/108:05:141
306877899116,4cyclictest0-21swapper/109:35:111
306877899115,4cyclictest3471945-21sed12:10:271
306877899114,2cyclictest191rcu_preempt10:50:151
306877899113,2cyclictest191rcu_preempt08:35:221
306877599118,2cyclictest3154169-21gltestperf08:30:140
306877599110,9cyclictest3123941-21seq08:00:180
306878599100,2cyclictest3068887-21sed07:10:003
306878399103,2cyclictest3091200-21irqcore07:30:142
306878399100,2cyclictest191rcu_preempt07:10:002
306877899108,1cyclictest3170052-21mii-tool08:45:181
306877899101,2cyclictest3142659-21grep08:15:221
306877899101,2cyclictest3142659-21grep08:15:221
306877599100,2cyclictest3071321-21kthreadcore07:10:180
30687789991,1cyclictest191rcu_preempt09:05:141
30687759985,1cyclictest0-21swapper/007:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional