You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 01:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4.osadl.org (updated Sat Apr 27, 2024 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
666983992927,1cyclictest906433-21idleruntime-cro10:24:590
666983992926,2cyclictest497-21dbus-daemon11:50:000
66699199245,11cyclictest1110276-21munin-run12:40:012
666983992420,3cyclictest894348-21kthreadcore10:15:210
666993992320,2cyclictest943979-21latency_hist10:50:003
66699399225,7cyclictest681857-21grep07:20:243
66699199222,6cyclictest767381-21basename08:45:012
666993992112,4cyclictest0-21swapper/311:14:483
666993992112,4cyclictest0-21swapper/309:22:483
666991992112,2cyclictest967017-21idleruntime-cro11:04:592
666983992117,3cyclictest891084-21cut10:15:000
666993992016,2cyclictest869274-21gltestperf10:00:143
666993992015,3cyclictest0-21swapper/311:50:013
666993992014,1cyclictest191rcu_preempt09:46:303
666991992017,2cyclictest840012-21kthreadcore09:40:172
666987992017,2cyclictest0-21swapper/111:00:001
666983992014,5cyclictest60650irq/128-enp0s29f1:rx-011:50:230
666993991915,3cyclictest677438-21grep07:20:003
666993991915,2cyclictest0-21swapper/308:40:003
666993991915,1cyclictest191rcu_preempt10:36:483
666993991914,4cyclictest959521-21sh11:00:003
666993991914,3cyclictest514-21in:imuxsock10:19:593
666993991914,1cyclictest191rcu_preempt12:16:043
666993991912,1cyclictest191rcu_preempt11:22:563
666993991912,1cyclictest191rcu_preempt11:22:563
666993991911,5cyclictest0-21swapper/311:32:193
666993991911,4cyclictest0-21swapper/309:25:593
666993991910,4cyclictest0-21swapper/312:25:443
666993991910,4cyclictest0-21swapper/312:08:473
666993991910,4cyclictest0-21swapper/309:54:323
666993991910,4cyclictest0-21swapper/309:37:543
666993991910,4cyclictest0-21swapper/309:34:503
666993991910,1cyclictest191rcu_preempt12:35:333
66699399190,3cyclictest0-21swapper/311:01:103
666991991916,2cyclictest989422-21sh11:20:002
666991991916,2cyclictest715473-21kthreadcore07:55:222
666987991915,2cyclictest778512-21gltestperf08:55:151
666983991916,2cyclictest854142-21fschecks_time09:50:160
666983991916,2cyclictest762890-21irqcore08:40:190
666983991916,2cyclictest708873-21basename07:50:000
666983991915,2cyclictest0-21swapper/012:10:010
66699399189,4cyclictest0-21swapper/311:55:303
66699399189,4cyclictest0-21swapper/309:42:473
66699399189,4cyclictest0-21swapper/307:30:263
66699399183,5cyclictest989446-21ssh11:20:003
66699399183,4cyclictest1100768-21seq12:31:113
66699399182,5cyclictest919230-21ssh10:30:563
66699399182,5cyclictest862608-21cut09:55:193
66699399182,5cyclictest763754-21grep08:40:203
666993991815,2cyclictest634375-21munin-node10:50:213
666993991815,2cyclictest512-21tpm2-abrmd08:25:003
666993991814,1cyclictest191rcu_preempt12:01:353
666993991814,1cyclictest191rcu_preempt11:25:433
666993991810,4cyclictest0-21swapper/309:10:063
66699199184,12cyclictest682664-21awk07:25:002
666991991814,2cyclictest0-21swapper/211:35:272
66698799180,1cyclictest0-21swapper/109:45:011
666983991814,2cyclictest60650irq/128-enp0s29f1:rx-010:00:100
66699399179,1cyclictest0-21swapper/307:55:273
66699399178,1cyclictest0-21swapper/307:15:013
66699399175,6cyclictest0-21swapper/310:25:403
66699399172,4cyclictest1087247-21sh12:23:523
666993991713,1cyclictest191rcu_preempt11:40:113
66699399170,7cyclictest707983-21awk07:45:203
666991991714,2cyclictest981949-21cron11:15:002
666991991714,2cyclictest824359-21idleruntime09:30:182
666991991713,2cyclictest699111-21irqcore07:40:182
666991991713,2cyclictest0-21swapper/211:55:122
666987991715,1cyclictest666979-21cyclictest12:10:011
666983991715,1cyclictest786061-21kthreadcore09:00:160
666983991714,2cyclictest61450irq/129-enp0s29f1:tx-012:25:470
666983991714,2cyclictest60650irq/128-enp0s29f1:rx-011:55:180
666983991714,2cyclictest60650irq/128-enp0s29f1:rx-011:25:370
666983991714,2cyclictest60650irq/128-enp0s29f1:rx-011:05:500
666983991714,2cyclictest60650irq/128-enp0s29f1:rx-010:40:160
666983991714,2cyclictest60650irq/128-enp0s29f1:rx-009:45:290
666983991714,2cyclictest60650irq/128-enp0s29f1:rx-008:31:250
666983991713,3cyclictest731397-21irqcore08:10:160
666983991713,3cyclictest60650irq/128-enp0s29f1:rx-011:14:110
66699399169,4cyclictest0-21swapper/310:14:013
66699399163,4cyclictest1018614-21seq11:38:483
66699399163,3cyclictest971569-21head11:05:243
66699399162,4cyclictest750619-21ls08:25:253
66699399162,3cyclictest929825-21cut10:40:213
66699399162,3cyclictest1031265-21ntpq11:45:243
66699399161,5cyclictest779774-21kthreadcore08:55:183
66699399161,5cyclictest50-21ksoftirqd/310:05:293
666993991612,1cyclictest191rcu_preempt09:15:253
666993991611,3cyclictest703125-21unixbench_multi07:40:323
66699199162,7cyclictest936253-21idleruntime-cro10:45:002
666991991614,1cyclictest0-21swapper/208:10:002
666991991613,2cyclictest401ktimers/210:38:342
666991991612,3cyclictest1064939-21apt12:10:012
666991991612,2cyclictest0-21swapper/209:55:172
666991991612,1cyclictest0-21swapper/212:25:252
66699199160,4cyclictest9038762timerwakeupswit10:20:242
66699199160,1cyclictest0-21swapper/211:45:002
666987991614,1cyclictest0-21swapper/111:10:001
666987991613,2cyclictest311ktimers/111:45:221
666987991613,2cyclictest0-21swapper/111:55:011
666987991612,2cyclictest0-21swapper/111:15:001
666987991610,5cyclictest260-21systemd-journal11:35:001
666983991614,2cyclictest60650irq/128-enp0s29f1:rx-011:00:020
666983991614,2cyclictest60650irq/128-enp0s29f1:rx-008:09:450
666983991614,1cyclictest60650irq/128-enp0s29f1:rx-011:39:020
666983991614,1cyclictest60650irq/128-enp0s29f1:rx-011:32:190
666983991614,1cyclictest60650irq/128-enp0s29f1:rx-010:58:140
666983991614,1cyclictest60650irq/128-enp0s29f1:rx-010:37:040
666983991614,1cyclictest60650irq/128-enp0s29f1:rx-010:32:440
666983991614,1cyclictest60650irq/128-enp0s29f1:rx-009:21:430
666983991613,2cyclictest666979-21cyclictest11:21:080
666983991613,2cyclictest666979-21cyclictest11:21:070
666983991613,2cyclictest666979-21cyclictest08:35:250
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-012:31:010
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-012:17:170
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-012:10:110
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-011:40:230
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-011:15:460
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-010:50:110
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-010:47:580
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-010:29:570
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-010:09:380
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-009:44:000
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-009:35:130
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-009:30:190
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-009:15:000
666983991613,2cyclictest60650irq/128-enp0s29f1:rx-009:05:120
666983991612,3cyclictest60650irq/128-enp0s29f1:rx-012:35:220
666983991612,3cyclictest60650irq/128-enp0s29f1:rx-009:55:180
66699399151,5cyclictest793689-21diskmemload10:23:493
666993991511,2cyclictest0-21swapper/309:05:003
66699399150,4cyclictest693708-21gltestperf07:35:143
66699399150,4cyclictest1066816-21irqstats12:10:173
66699199159,4cyclictest818431-21tr09:25:202
66699199158,5cyclictest939310-21tr10:45:182
66699199153,3cyclictest833-21runrttasks12:33:452
66699199153,10cyclictest0-21swapper/207:10:012
66699199151,5cyclictest741225-21awk08:20:002
666991991513,2cyclictest62050irq/141-enp0s29f1:tx-609:36:242
666991991512,2cyclictest971667-21ntp_kernel_pll_11:05:252
666991991512,2cyclictest401ktimers/212:10:102
666991991511,3cyclictest778206-21cpuspeed_turbos08:55:132
66699199151,12cyclictest698346-21awk07:40:002
666991991511,2cyclictest0-21swapper/211:50:002
666991991511,2cyclictest0-21swapper/211:35:002
666991991510,3cyclictest952974-21irqcore10:55:182
66698799159,5cyclictest944906-21gltestperf10:50:171
66698799159,5cyclictest0-21swapper/112:25:191
666987991513,1cyclictest989423-21sh11:20:001
666987991513,1cyclictest311ktimers/110:20:361
666987991512,2cyclictest906904-21cpuspeed_turbos10:25:111
666987991512,2cyclictest687409-21unixbench_multi07:25:281
666987991512,2cyclictest0-21swapper/110:50:001
666987991512,2cyclictest0-21swapper/107:15:001
666987991510,3cyclictest260-21systemd-journal09:40:001
666983991514,1cyclictest60650irq/128-enp0s29f1:rx-012:22:150
666983991513,2cyclictest60650irq/128-enp0s29f1:rx-009:26:570
666983991513,2cyclictest60650irq/128-enp0s29f1:rx-007:34:360
666983991513,1cyclictest60650irq/128-enp0s29f1:rx-008:49:140
666983991512,2cyclictest736512-21gltestperf08:15:170
666983991512,2cyclictest61450irq/129-enp0s29f1:tx-012:00:090
666983991512,2cyclictest60650irq/128-enp0s29f1:rx-009:16:290
666983991512,2cyclictest60650irq/128-enp0s29f1:rx-008:25:330
666983991512,2cyclictest60650irq/128-enp0s29f1:rx-007:55:190
666983991512,2cyclictest60650irq/128-enp0s29f1:rx-007:52:330
666983991512,2cyclictest60650irq/128-enp0s29f1:rx-007:35:100
666983991512,2cyclictest60650irq/128-enp0s29f1:rx-007:10:180
666983991511,3cyclictest778474-21gltestperf08:55:150
666983991511,3cyclictest703592-21idleruntime-cro07:45:000
66699399142,2cyclictest50-21ksoftirqd/309:05:133
66699399141,3cyclictest735311-21sed08:10:253
66699399140,5cyclictest767703-21sort08:45:163
66699399140,4cyclictest50-21ksoftirqd/308:00:143
66699399140,3cyclictest737271-21irqstats08:15:203
66699199148,5cyclictest951686-21gpgv10:55:002
666991991412,1cyclictest401ktimers/209:23:512
666991991412,1cyclictest0-21swapper/209:45:122
666991991411,2cyclictest782841-21kworker/u8:1+xprtiod10:05:072
666991991411,2cyclictest401ktimers/212:23:572
666991991411,2cyclictest401ktimers/209:15:012
666991991410,3cyclictest885047-21kthreadcore10:10:182
666991991410,3cyclictest782841-21kworker/u8:1+xprtiod11:21:042
666991991410,3cyclictest782841-21kworker/u8:1+xprtiod11:21:032
666991991410,2cyclictest741623-21cut08:20:142
666991991410,2cyclictest0-21swapper/212:15:172
66698799145,1cyclictest191rcu_preempt12:33:441
666987991411,2cyclictest828635-21unixbench_multi09:30:291
666987991411,2cyclictest708443-21unixbench_singl07:45:241
666987991411,2cyclictest2803479-21kworker/u8:3+xprtiod09:12:031
666987991411,2cyclictest0-21swapper/110:00:021
666987991410,3cyclictest752169-21fschecks_time08:30:131
66698799140,5cyclictest861118-21cat09:55:011
66699399139,3cyclictest725533-21gltestperf08:05:143
66699399139,2cyclictest0-21swapper/308:30:163
66699399136,1cyclictest0-21swapper/307:50:163
66699399133,3cyclictest50-21ksoftirqd/308:55:003
66699399131,4cyclictest50-21ksoftirqd/307:10:013
66699399130,4cyclictest683403-21awk07:25:173
66699199139,3cyclictest911358-21unixbench-2d10:25:252
66699199139,3cyclictest401ktimers/209:15:512
66699199139,2cyclictest0-21swapper/207:50:112
66699199137,5cyclictest853861-21apt-get09:50:132
666991991311,1cyclictest0-21swapper/211:55:012
666991991310,2cyclictest967033-21kworker/u8:0+xprtiod12:03:532
666991991310,2cyclictest0-21swapper/210:00:212
666991991310,2cyclictest0-21swapper/207:50:002
66698799139,2cyclictest0-21swapper/111:40:141
66698799139,2cyclictest0-21swapper/108:40:141
66698799138,4cyclictest887386-21tr10:10:201
66698799138,4cyclictest724995-21systemd-run08:05:001
66698799131,3cyclictest0-21swapper/112:40:001
666987991311,1cyclictest802622-21kthreadcore09:15:181
666987991310,2cyclictest995903-21kworker/u8:2+xprtiod11:28:311
666987991310,2cyclictest990076-21cut11:20:141
666987991310,2cyclictest990076-21cut11:20:131
666987991310,2cyclictest967033-21kworker/u8:0+xprtiod12:11:351
666987991310,2cyclictest921786-21cpuspeed_turbos10:35:121
666987991310,2cyclictest816771-21gltestperf09:25:161
666987991310,2cyclictest782841-21kworker/u8:1+xprtiod10:34:111
666987991310,2cyclictest782841-21kworker/u8:1+xprtiod09:45:181
666987991310,2cyclictest767708-21cpuspeed_turbos08:45:161
666987991310,2cyclictest0-21swapper/112:15:161
666987991310,1cyclictest0-21swapper/110:05:211
66698799130,3cyclictest714114-21awk07:55:001
66698799130,1cyclictest0-21swapper/112:24:561
666983991310,2cyclictest60650irq/128-enp0s29f1:rx-008:24:470
666983991310,2cyclictest60650irq/128-enp0s29f1:rx-008:00:160
66699199129,2cyclictest689257-21kthreadcore07:30:212
66699199129,2cyclictest0-21swapper/210:15:012
66699199128,3cyclictest0-21swapper/208:25:172
66699199127,3cyclictest788440-21turbostat09:05:002
66699199127,3cyclictest756856-21idleruntime-cro08:35:002
66699199126,4cyclictest997106-21sshd11:25:032
66699199126,4cyclictest918563-21wc10:30:222
66698799129,2cyclictest967033-21kworker/u8:0+xprtiod11:58:571
66698799129,1cyclictest0-21swapper/108:20:001
66698799128,3cyclictest1050674-21gltestperf12:00:131
66698799127,3cyclictest260-21systemd-journal07:39:391
66698799121,4cyclictest0-21swapper/111:01:471
66698399129,2cyclictest675942-21kthreadcore07:15:190
66698399128,1cyclictest60650irq/128-enp0s29f1:rx-007:20:250
66698399127,3cyclictest687897-21dump-pmu-power07:30:000
666983991210,1cyclictest60650irq/128-enp0s29f1:rx-008:50:130
66699199118,2cyclictest761685-21unixbench_multi08:35:312
66699199118,2cyclictest677422-21cron07:20:002
66699199118,2cyclictest0-21swapper/208:50:212
66699199118,1cyclictest0-21swapper/209:05:132
66699199117,2cyclictest724171-21nvmesmart_nvme008:00:252
66699199117,2cyclictest0-21swapper/207:25:182
66699199116,3cyclictest260-21systemd-journal07:15:002
66698799118,2cyclictest782841-21kworker/u8:1+xprtiod10:02:031
66698799118,2cyclictest772942-21cpuspeed_turbos08:50:111
66698799118,2cyclictest757629-21irqcore08:35:211
66698799118,2cyclictest672829-21cut07:15:141
66698799118,2cyclictest0-21swapper/109:00:151
66698799118,2cyclictest0-21swapper/107:55:191
66698799118,2cyclictest0-21swapper/107:35:001
66698799117,3cyclictest891659-21apt-config10:15:001
66698799117,3cyclictest311ktimers/110:40:071
66698799116,4cyclictest1016096-21tr11:35:211
66699199107,2cyclictest833-21runrttasks08:45:162
66699199103,5cyclictest497-21dbus-daemon08:15:002
66698799107,2cyclictest0-21swapper/107:40:231
66698799106,3cyclictest788776-21cpuspeed_turbos09:05:121
66698799100,8cyclictest730213-21latency_hist08:10:001
6669879997,1cyclictest0-21swapper/108:20:181
6669879995,3cyclictest734936-21sed08:10:191
6669879994,4cyclictest260-21systemd-journal07:20:071
6669879983,4cyclictest746704-21apt-get08:25:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional