You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-24 - 18:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4.osadl.org (updated Sat Feb 24, 2024 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2348552992421,2cyclictest2543926-21latency_hist09:55:012
2348554992320,2cyclictest519-21in:imuxsock10:45:003
2348554992218,2cyclictest2787550-21latency_hist12:35:013
2348554991916,2cyclictest2438896-21gltestperf08:35:313
2348554991915,2cyclictest2564117-21timerandwakeup10:05:313
2348554991915,2cyclictest0-21swapper/310:25:403
2348554991914,3cyclictest2772288-21ls12:25:003
234854799193,8cyclictest2574340-21awk10:15:001
2348547991916,2cyclictest2636187-21kthreadcore10:55:231
2348547991916,2cyclictest2500884-21kthreadcore09:25:261
2348544991912,5cyclictest149712-21systemd-journal10:35:000
2348554991815,2cyclictest2513879-21gltestperf09:35:273
234855299185,2cyclictest191rcu_preempt09:35:232
2348552991815,2cyclictest2734405-21sed12:00:232
2348552991815,2cyclictest2733168-21sh12:00:002
2348547991815,2cyclictest514-21systemd-logind09:25:011
2348544991814,3cyclictest0-21swapper/010:50:310
2348544991814,2cyclictest0-21swapper/011:50:000
2348544991814,2cyclictest0-21swapper/009:50:010
2348554991714,2cyclictest2401153-21cpuspeed_turbos08:00:223
2348552991715,1cyclictest2490286-21awk09:20:002
2348547991713,3cyclictest2559929-21gltestperf10:05:211
2348547991712,3cyclictest0-21swapper/108:50:001
2348547991710,5cyclictest149712-21systemd-journal11:05:001
2348544991714,2cyclictest59150irq/127-enp0s29f1:rx-012:24:440
2348544991714,2cyclictest59150irq/127-enp0s29f1:rx-012:08:080
2348544991714,2cyclictest59150irq/127-enp0s29f1:rx-011:04:420
2348544991714,2cyclictest59150irq/127-enp0s29f1:rx-010:49:300
2348544991714,2cyclictest59150irq/127-enp0s29f1:rx-009:56:150
2348544991714,2cyclictest59150irq/127-enp0s29f1:rx-009:21:000
2348544991713,3cyclictest2605346-21gltestperf10:35:280
2348544991713,3cyclictest2444233-21sed08:40:280
2348544991713,2cyclictest59150irq/127-enp0s29f1:rx-012:00:210
234855499169,5cyclictest2631792-21ntp_states10:50:293
2348554991613,2cyclictest491ktimers/312:15:473
2348554991613,2cyclictest2437800-21latency_hist08:35:013
2348554991613,2cyclictest2437800-21latency_hist08:35:003
2348554991612,3cyclictest2777243-21unixbench_singl12:25:383
2348554991612,3cyclictest0-21swapper/307:24:593
2348554991612,2cyclictest0-21swapper/310:25:003
2348554991612,2cyclictest0-21swapper/310:05:013
2348554991610,4cyclictest149712-21systemd-journal09:00:223
234855499160,3cyclictest26620701ssh11:10:383
2348552991614,1cyclictest2795152-21latency_hist12:40:002
2348552991614,1cyclictest2379865-21cron07:39:592
2348552991613,2cyclictest60550irq/140-enp0s29f1:tx-610:54:132
2348552991612,3cyclictest2741809-21cpuspeed_turbos12:05:252
2348552991612,2cyclictest0-21swapper/211:25:352
234854799169,5cyclictest0-21swapper/109:15:001
2348547991613,2cyclictest2634663-21idleruntime-cro10:55:011
2348547991613,2cyclictest2442566-21grep08:35:351
2348547991612,3cyclictest2757587-21fschecks_time12:15:241
2348547991612,3cyclictest2385618-21fschecks_time07:45:231
2348547991612,3cyclictest1-21systemd11:47:551
2348544991614,2cyclictest59150irq/127-enp0s29f1:rx-007:40:270
2348544991614,1cyclictest59150irq/127-enp0s29f1:rx-012:17:550
2348544991614,1cyclictest59150irq/127-enp0s29f1:rx-011:50:020
2348544991614,1cyclictest59150irq/127-enp0s29f1:rx-011:33:020
2348544991614,1cyclictest59150irq/127-enp0s29f1:rx-011:23:200
2348544991614,1cyclictest59150irq/127-enp0s29f1:rx-009:35:120
2348544991614,1cyclictest59150irq/127-enp0s29f1:rx-007:49:120
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-012:30:500
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-012:29:250
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-012:10:110
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-011:15:240
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-010:55:180
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-010:41:100
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-009:51:440
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-009:40:310
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-009:15:200
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-009:14:550
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-008:45:360
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-008:25:250
2348544991613,2cyclictest59150irq/127-enp0s29f1:rx-007:25:250
2348544991613,2cyclictest0-21swapper/008:05:000
2348544991612,3cyclictest59150irq/127-enp0s29f1:rx-010:15:360
2348544991612,3cyclictest59150irq/127-enp0s29f1:rx-010:10:230
2348544991612,2cyclictest59950irq/128-enp0s29f1:tx-011:25:210
234855499155,4cyclictest0-21swapper/311:55:273
2348554991513,1cyclictest2348805-21cpu07:10:213
234855499151,2cyclictest191rcu_preempt09:58:203
2348554991512,2cyclictest2795085-21systemd-run12:40:003
2348554991512,2cyclictest2665657-21gltestperf11:15:273
2348554991512,2cyclictest2639057-21latency10:55:253
2348554991512,2cyclictest2524132-21kthreadcore09:40:313
2348554991511,3cyclictest2688163-21cpuspeed_turbos11:30:233
2348554991511,3cyclictest2368978-21unixbench_multi07:25:313
2348554991511,3cyclictest0-21swapper/309:25:233
2348554991511,2cyclictest0-21swapper/312:10:213
2348554991511,2cyclictest0-21swapper/311:45:003
2348554991511,2cyclictest0-21swapper/311:45:003
2348554991511,2cyclictest0-21swapper/309:55:013
2348554991511,2cyclictest0-21swapper/308:24:593
234855499150,3cyclictest2597479-21cut10:30:213
234855299153,2cyclictest191rcu_preempt11:45:242
234855299151,3cyclictest2749726-21apt-get12:10:202
2348552991513,1cyclictest2427733-21cut08:25:232
2348552991512,2cyclictest2459146-21ls08:55:002
2348552991512,2cyclictest2448700-21cron08:45:002
2348552991512,2cyclictest2416070-21unixbench_singl08:10:402
2348552991512,2cyclictest2363805-21unixbench_singl07:20:352
2348552991512,2cyclictest0-21swapper/210:30:212
2348552991512,2cyclictest0-21swapper/207:25:272
2348552991512,1cyclictest0-21swapper/210:25:402
2348552991511,3cyclictest517-21tpm2-abrmd07:20:002
2348552991511,3cyclictest2556750-21unixbench_multi10:00:372
2348552991511,3cyclictest2463932-21unixbench_multi08:55:352
234854799157,6cyclictest149712-21systemd-journal09:20:001
2348547991511,3cyclictest2537675-21kthreadcore09:50:281
2348547991511,3cyclictest0-21swapper/108:05:001
2348547991511,2cyclictest0-21swapper/112:10:001
2348547991511,2cyclictest0-21swapper/111:35:001
2348547991510,4cyclictest149712-21systemd-journal12:29:551
2348544991513,2cyclictest59150irq/127-enp0s29f1:rx-008:21:550
2348544991513,2cyclictest59150irq/127-enp0s29f1:rx-008:05:300
2348544991513,2cyclictest59150irq/127-enp0s29f1:rx-007:59:400
2348544991513,1cyclictest59150irq/127-enp0s29f1:rx-011:40:530
2348544991513,1cyclictest59150irq/127-enp0s29f1:rx-011:40:530
2348544991513,1cyclictest59150irq/127-enp0s29f1:rx-010:05:230
2348544991513,1cyclictest59150irq/127-enp0s29f1:rx-007:17:400
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-011:55:280
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-011:10:270
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-011:05:150
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-010:25:330
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-009:30:010
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-008:52:370
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-008:35:360
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-008:30:350
2348544991512,2cyclictest59150irq/127-enp0s29f1:rx-008:30:350
2348544991512,2cyclictest2353271-21unixbench_multi07:10:320
2348544991511,3cyclictest59150irq/127-enp0s29f1:rx-009:25:250
2348544991511,3cyclictest2695939-21gltestperf11:35:240
2348544991511,3cyclictest2421692-21cron08:20:000
234855499149,4cyclictest2647505-21sshd11:00:543
234855499142,2cyclictest2650165-21/usr/sbin/munin11:05:373
234855499142,1cyclictest2474823-21diskmemload09:21:483
2348554991412,1cyclictest2412021-21tr08:10:303
2348554991412,1cyclictest0-21swapper/307:20:003
2348554991411,2cyclictest491ktimers/309:11:083
2348554991411,2cyclictest491ktimers/307:45:223
2348554991411,2cyclictest2748854-21cron12:10:003
2348554991411,2cyclictest2416935-21fschecks_count08:15:233
2348554991410,3cyclictest2571823-21unixbench_multi10:10:363
234855499140,1cyclictest24643881latency_hist09:00:013
234855499140,1cyclictest0-21swapper/311:50:013
234855299143,2cyclictest191rcu_preempt12:25:002
234855299142,2cyclictest191rcu_preempt12:28:432
2348552991411,2cyclictest2703300-21cpuspeed_turbos11:40:212
2348552991411,2cyclictest2703300-21cpuspeed_turbos11:40:212
2348552991411,2cyclictest2417047-21gltestperf08:15:242
2348552991411,2cyclictest2389615-21proc_pri07:45:312
2348552991411,2cyclictest0-21swapper/211:00:002
2348552991411,2cyclictest0-21swapper/209:20:212
2348552991410,3cyclictest2502650-21ntpq09:25:302
2348552991410,3cyclictest2422061-21cpuspeed_turbos08:20:232
2348552991410,2cyclictest0-21swapper/211:30:292
234855299140,3cyclictest0-21swapper/209:55:182
234855299140,13cyclictest0-21swapper/209:40:242
234854799149,3cyclictest149712-21systemd-journal08:33:541
234854799149,3cyclictest149712-21systemd-journal08:33:541
234854799148,5cyclictest2523024-21tr09:40:311
2348547991413,1cyclictest311ktimers/110:49:151
2348547991411,2cyclictest2528780-21fschecks_count09:45:221
2348547991410,3cyclictest2673436-21irqcore11:20:331
2348547991410,3cyclictest2605025-21cpuspeed_turbos10:35:261
234854499147,5cyclictest503-21dbus-daemon09:00:000
2348544991412,2cyclictest59150irq/127-enp0s29f1:rx-007:23:080
2348544991411,2cyclictest59150irq/127-enp0s29f1:rx-012:35:300
2348544991411,2cyclictest59150irq/127-enp0s29f1:rx-009:09:590
2348544991411,2cyclictest59150irq/127-enp0s29f1:rx-009:00:310
2348544991411,2cyclictest59150irq/127-enp0s29f1:rx-007:50:270
234855499139,3cyclictest2738325-21ntp_states12:00:303
234855499139,2cyclictest0-21swapper/308:45:243
234855499132,1cyclictest2474823-21diskmemload09:34:553
2348554991310,2cyclictest491ktimers/309:15:133
2348554991310,2cyclictest2677553-21unixbench_singl11:20:403
2348554991310,2cyclictest2473813-21latency09:05:333
234855499130,3cyclictest2700312-21grep11:35:363
234855499130,3cyclictest2626882-21ssh10:49:353
234855299139,3cyclictest401ktimers/210:46:152
234855299139,3cyclictest2535908-21apt-key09:50:012
234855299139,2cyclictest27184002sleep211:50:192
234855299139,2cyclictest2380271-21cut07:40:222
234855299137,5cyclictest2568960-21cut10:10:292
234855299137,4cyclictest2697008-21cut11:35:272
234855299137,4cyclictest149712-21systemd-journal11:02:532
234855299136,5cyclictest2610635-21seq10:37:262
234855299133,2cyclictest191rcu_preempt09:10:282
234855299131,4cyclictest0-21swapper/209:30:262
234855299131,3cyclictest2758480-21ps12:15:282
2348552991311,1cyclictest2562535-21kthreadcore10:05:252
2348552991311,1cyclictest2408092-21kthreadcore08:05:282
2348552991311,1cyclictest0-21swapper/211:10:322
2348552991310,2cyclictest2672436-21munin-plugin-st11:20:002
2348552991310,2cyclictest0-21swapper/207:30:272
234855299130,4cyclictest2474823-21diskmemload12:30:202
234854799139,3cyclictest2695700-21cpuspeed_turbos11:35:221
234854799139,3cyclictest2665442-21cpuspeed_turbos11:15:241
234854799139,3cyclictest2658137-21gltestperf11:10:301
234854799139,3cyclictest2427714-21cpuspeed_turbos08:25:231
234854799139,2cyclictest0-21swapper/109:30:241
234854799139,2cyclictest0-21swapper/108:10:401
234854799138,4cyclictest503-21dbus-daemon10:35:001
234854799138,3cyclictest0-21swapper/109:35:301
234854799133,8cyclictest2619559-21munin-plugin-st10:45:001
234854799131,4cyclictest0-21swapper/111:25:211
2348547991311,1cyclictest311ktimers/112:30:061
234854799131,10cyclictest0-21swapper/108:55:001
2348547991310,2cyclictest2723088-21unixbench_singl11:50:331
2348547991310,2cyclictest2592958-21kthreadcore10:25:331
2348547991310,2cyclictest2359364-21cut07:20:221
234855499129,2cyclictest2531949-21kthreadcore09:45:283
234855499129,2cyclictest0-21swapper/311:50:303
234855499128,3cyclictest2427714-21cpuspeed_turbos08:25:233
234855499128,3cyclictest2370810-21kthreadcore07:30:283
234855499128,2cyclictest0-21swapper/308:40:373
234855499127,4cyclictest503-21dbus-daemon08:55:003
234855499125,6cyclictest2687660-21seq11:30:003
234855499120,4cyclictest2521524-21kworker/u8:1+xprtiod10:36:513
234855499120,3cyclictest0-21swapper/307:55:203
234855499120,2cyclictest191rcu_preempt07:50:243
234855299129,2cyclictest2449099-21cpuspeed_turbos08:45:222
234855299129,2cyclictest0-21swapper/211:05:252
234855299129,2cyclictest0-21swapper/210:20:002
234855299128,2cyclictest0-21swapper/208:40:002
234855299125,5cyclictest503-21dbus-daemon09:10:002
234855299124,7cyclictest391rcuc/210:20:252
2348552991210,1cyclictest0-21swapper/210:40:242
234855299120,4cyclictest2404204-21tr08:00:292
234854799129,2cyclictest311ktimers/112:20:281
234854799129,2cyclictest311ktimers/111:55:201
234854799129,2cyclictest311ktimers/110:15:251
234854799129,2cyclictest2390792-21cpuspeed_turbos07:50:211
234854799129,2cyclictest2375422-21sed07:35:271
234854799128,3cyclictest311ktimers/111:43:491
234854799128,3cyclictest311ktimers/111:43:491
234854799128,2cyclictest0-21swapper/108:15:251
234854799127,4cyclictest2582410-21tr10:20:181
234854799126,4cyclictest2757008-21cat12:15:001
234854799123,2cyclictest2474823-21diskmemload12:03:261
234854799120,10cyclictest2448732-21awk08:45:001
2348544991210,2cyclictest59150irq/127-enp0s29f1:rx-007:37:550
234855499119,1cyclictest2348539-21cyclictest10:15:273
234855499117,3cyclictest2410251-21memory08:05:293
234855499116,4cyclictest2375095-21diskstats07:35:243
234855299118,1cyclictest0-21swapper/211:20:352
234855299117,3cyclictest2396401-21irqcore07:55:262
234855299117,2cyclictest0-21swapper/209:00:282
234855299110,3cyclictest2438081-21cat08:35:012
234855299110,3cyclictest2438081-21cat08:35:012
234855299110,2cyclictest0-21swapper/207:50:232
234854799118,2cyclictest2354151-21cpuspeed_turbos07:15:231
234854799117,2cyclictest0-21swapper/110:00:301
234854799116,4cyclictest2789537-21kthreadcore12:35:281
234854799116,4cyclictest2544711-21df_inode09:55:201
234854799116,4cyclictest2395876-21apt-get07:55:201
234854499116,4cyclictest2411752-21cut08:10:260
234854499116,4cyclictest2369992-21cut07:30:240
234855499100,3cyclictest0-21swapper/307:40:203
234855299106,2cyclictest0-21swapper/207:10:242
234854799107,2cyclictest818-21runrttasks07:40:221
234854799106,3cyclictest311ktimers/111:05:261
234854799106,3cyclictest311ktimers/107:25:171
234854799106,3cyclictest2459511-21cut08:55:221
234854799106,2cyclictest0-21swapper/108:05:271
234854799106,2cyclictest0-21swapper/107:10:241
234854799105,4cyclictest2372576-21tr07:30:291
23485479996,2cyclictest311ktimers/109:07:331
23485479995,3cyclictest0-21swapper/109:00:251
23485479994,4cyclictest2423037-21sed08:20:281
23485479982,4cyclictest2348548-21latency_hist07:09:591
23485549962,2cyclictest2348467-21latency_hist07:09:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional