You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 15:15

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack9slot0.osadl.org (updated Sun Dec 04, 2022 12:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1125921450,2sleep0679099cyclictest12:27:120
1938721410,1sleep3679699cyclictest11:56:493
2058221330,1sleep320579-21systemd12:35:493
3246821150,2sleep132469-21grep10:56:101
560521130,0sleep25604-21sshd09:17:392
560521130,0sleep25604-21sshd09:17:392
2824921100,1sleep128248-21systemd11:13:501
222652890,0sleep020214-21kworker/0:012:12:410
325562780,0sleep2331rcuc/211:39:522
195012750,1sleep10-21swapper/109:28:521
164052750,1sleep2856-21NetworkManager10:44:452
106142740,2sleep3431ktimersoftd/311:12:323
36172720,8sleep288250irq/26-p4p1-rx-12:23:572
42582710,0sleep00-21swapper/012:29:210
40472710,1sleep2331rcuc/211:58:042
265362710,0sleep0141rcuc/012:02:310
172772710,1sleep217273-21systemd-cgroups10:37:122
92602690,0sleep10-21swapper/109:50:571
92602690,0sleep10-21swapper/109:50:571
319952690,2sleep2679599cyclictest10:30:462
196752680,0sleep00-21swapper/011:41:270
319602670,1sleep3808-21dbus-daemon12:26:153
212272670,0sleep3421rcuc/310:22:173
290532650,0sleep10-21swapper/109:42:191
39832600,3sleep388350irq/27-p4p1-tx-12:13:443
259692600,0sleep00-21swapper/011:36:500
259692600,0sleep00-21swapper/011:36:500
157542600,0sleep10-21swapper/112:22:241
122832600,1sleep012284-21grepconf.sh10:39:180
112062590,1sleep01528-21nfsd09:43:220
652825843,9sleep00-21swapper/007:06:580
58682580,0sleep20-21swapper/211:48:022
290472560,0sleep10-21swapper/110:43:081
208892560,0sleep30-21swapper/310:45:063
165682560,0sleep10-21swapper/109:56:341
645825440,8sleep10-21swapper/107:06:071
422325229,16sleep20-21swapper/207:02:392
627125025,8sleep30-21swapper/307:03:483
199972360,0sleep219996-21systemd-cgroups09:11:142
225892260,0sleep0598-21systemd-journal10:07:190
35062250,0sleep13504-21sshd09:35:101
6790992421,1cyclictest9-21ksoftirqd/012:32:580
312242240,0sleep31-21systemd10:51:033
276272240,1sleep327628-21bash11:49:513
145292240,0sleep00-21swapper/011:02:270
124422230,1sleep3421rcuc/310:31:473
259662220,1sleep31527-21nfsd10:53:043
106332220,0sleep20-21swapper/210:49:262
679599219,1cyclictest35-21ksoftirqd/212:32:302
679599217,2cyclictest35-21ksoftirqd/209:42:452
679599214,3cyclictest35-21ksoftirqd/209:32:532
6795992118,1cyclictest35-21ksoftirqd/211:16:012
6795992116,3cyclictest35-21ksoftirqd/212:30:232
679099219,1cyclictest9-21ksoftirqd/011:15:480
288442210,1sleep128847-21kworker/u8:411:00:591
91412200,1sleep1251ktimersoftd/112:06:171
679599209,1cyclictest35-21ksoftirqd/212:05:332
679599209,1cyclictest35-21ksoftirqd/211:01:502
679599208,1cyclictest35-21ksoftirqd/210:52:342
679599204,3cyclictest35-21ksoftirqd/209:41:222
679599201,3cyclictest4765-21systemd-cgroups09:55:382
679099209,1cyclictest9-21ksoftirqd/010:43:290
6790992018,1cyclictest24444-21kworker/0:609:53:590
29212200,0sleep20-21swapper/211:34:592
29212200,0sleep20-21swapper/211:34:592
148832200,1sleep30-21swapper/309:20:533
148832200,1sleep30-21swapper/309:20:533
89882190,1sleep38949-21systemd10:26:263
679699190,5cyclictest808-21dbus-daemon09:30:193
679599198,1cyclictest35-21ksoftirqd/209:31:532
679599197,3cyclictest35-21ksoftirqd/211:08:072
679599197,1cyclictest35-21ksoftirqd/210:20:302
679599196,4cyclictest35-21ksoftirqd/209:14:142
6795991911,1cyclictest35-21ksoftirqd/212:21:192
679099197,3cyclictest9-21ksoftirqd/010:49:370
6790991917,1cyclictest8565-21kworker/0:108:50:020
6790991917,1cyclictest15952-21kworker/0:511:29:190
58242190,0sleep30-21swapper/310:33:443
257002190,0sleep2331rcuc/209:59:482
22842190,1sleep115414-1kworker/1:2H11:24:401
183822190,1sleep318381-21bash12:09:483
679599187,2cyclictest35-21ksoftirqd/211:42:482
679599187,1cyclictest35-21ksoftirqd/209:49:232
679599187,1cyclictest35-21ksoftirqd/209:49:232
679599186,3cyclictest35-21ksoftirqd/210:22:442
679599186,3cyclictest35-21ksoftirqd/210:02:472
679599186,2cyclictest35-21ksoftirqd/212:11:142
6795991815,2cyclictest35-21ksoftirqd/212:12:592
679099187,1cyclictest9-21ksoftirqd/010:28:150
6790991817,0cyclictest8565-21kworker/0:109:02:200
6790991817,0cyclictest8565-21kworker/0:108:43:060
6790991816,1cyclictest4833-21kworker/0:209:15:520
6790991816,1cyclictest19544-21kworker/0:211:54:050
38522180,0sleep10-21swapper/111:22:081
32672180,1sleep03265-21grepconf.sh09:35:090
124632180,0sleep00-21swapper/010:11:280
679699173,3cyclictest1-21systemd11:24:073
679699170,6cyclictest3382-21rm10:05:463
679699170,6cyclictest3085-21bash10:00:353
679599178,1cyclictest35-21ksoftirqd/211:31:132
679599177,1cyclictest35-21ksoftirqd/209:22:582
679599176,1cyclictest35-21ksoftirqd/210:16:012
679599175,3cyclictest35-21ksoftirqd/210:39:102
6794991713,2cyclictest7693-21memory09:22:511
679099178,1cyclictest9-21ksoftirqd/010:22:190
6790991716,0cyclictest674-40kipmi008:32:470
6790991716,0cyclictest25247-21kworker/0:207:47:480
6790991715,1cyclictest9-21ksoftirqd/012:09:590
679099170,1cyclictest111rcu_preempt09:26:300
267872170,1sleep3421rcuc/312:31:123
7242160,0sleep10-21swapper/110:15:341
679699162,4cyclictest808-21dbus-daemon09:37:383
679699161,7cyclictest0-21swapper/309:33:323
679599167,1cyclictest35-21ksoftirqd/211:25:592
679599166,1cyclictest35-21ksoftirqd/211:53:092
679599166,1cyclictest35-21ksoftirqd/211:03:152
679599165,1cyclictest35-21ksoftirqd/211:17:542
6795991615,0cyclictest9431-21kworker/2:107:37:242
679499168,5cyclictest18495-21sshd11:05:281
6790991615,0cyclictest674-40kipmi007:12:450
6790991614,1cyclictest9-21ksoftirqd/009:19:140
6790991614,1cyclictest9-21ksoftirqd/009:19:140
6790991614,1cyclictest15017-21kworker/0:107:24:560
6790991610,2cyclictest9-21ksoftirqd/012:02:280
679699158,3cyclictest44-21ksoftirqd/309:45:503
679699153,3cyclictest21797-21systemd11:46:493
679699153,3cyclictest15923-21systemctl09:26:073
679699153,2cyclictest32486-21grep11:11:423
679699152,3cyclictest808-21dbus-daemon09:08:473
679699152,2cyclictest808-21dbus-daemon11:03:293
679699150,3cyclictest5629-21bash11:30:093
679699150,3cyclictest1541-21sshd11:57:533
679699150,3cyclictest0-21swapper/311:41:553
679699150,3cyclictest0-21swapper/311:34:073
679699150,3cyclictest0-21swapper/311:34:073
679599156,3cyclictest35-21ksoftirqd/210:07:472
6795991514,0cyclictest0-21swapper/208:34:462
679599150,14cyclictest9431-21kworker/2:108:50:122
679599150,14cyclictest9431-21kworker/2:108:43:262
679599150,14cyclictest9431-21kworker/2:108:08:262
6794991511,2cyclictest1528-21nfsd11:10:161
679099158,1cyclictest9-21ksoftirqd/010:01:420
679099156,1cyclictest9-21ksoftirqd/011:04:040
679099153,3cyclictest9-21ksoftirqd/010:36:060
679099152,1cyclictest808-21dbus-daemon11:11:310
6790991513,1cyclictest9-21ksoftirqd/011:19:510
6790991513,1cyclictest24444-21kworker/0:610:25:110
679099151,2cyclictest121rcu_sched10:15:140
679099151,1cyclictest808-21dbus-daemon09:47:570
679099151,1cyclictest808-21dbus-daemon09:47:570
679099151,1cyclictest121rcu_sched09:37:510
94832140,0sleep19482-21grep09:10:251
679699144,2cyclictest16929-21sshd09:54:023
679699142,2cyclictest17039-21id10:11:493
679699140,3cyclictest7585-21systemd10:41:313
679699140,3cyclictest2215-21bash10:13:043
679699140,3cyclictest19647-21bash09:49:133
679699140,3cyclictest19647-21bash09:49:133
679699140,3cyclictest11154-21bash11:20:073
679699140,2cyclictest17927-21grepconf.sh12:19:583
679699140,1cyclictest0-21swapper/312:02:343
679599140,13cyclictest9431-21kworker/2:108:04:482
679599140,13cyclictest9431-21kworker/2:107:38:582
679499141,3cyclictest121rcu_sched11:57:441
6794991411,1cyclictest26-21ksoftirqd/112:14:431
679099149,1cyclictest9-21ksoftirqd/012:18:230
679099142,1cyclictest9-21ksoftirqd/009:31:080
679099141,1cyclictest121rcu_sched09:09:500
6790991411,1cyclictest9-21ksoftirqd/011:23:500
6790991411,1cyclictest9-21ksoftirqd/010:56:360
6790991410,1cyclictest9-21ksoftirqd/011:42:420
65052140,0sleep09-21ksoftirqd/011:50:450
679699130,4cyclictest26517-21grepconf.sh09:14:123
679699130,3cyclictest21783-21rm10:57:503
679699130,12cyclictest0-21swapper/308:45:403
6795991313,0cyclictest35-21ksoftirqd/208:27:202
6795991313,0cyclictest0-21swapper/208:39:282
6795991313,0cyclictest0-21swapper/208:13:482
6795991312,0cyclictest9431-21kworker/2:109:04:142
6795991312,0cyclictest9431-21kworker/2:109:04:142
6795991312,0cyclictest0-21swapper/208:58:422
6795991312,0cyclictest0-21swapper/207:51:262
6795991311,1cyclictest9431-21kworker/2:107:32:122
679599130,12cyclictest9431-21kworker/2:108:56:582
679499139,2cyclictest808-21dbus-daemon10:02:451
679499139,2cyclictest26-21ksoftirqd/112:35:591
679499138,2cyclictest26-21ksoftirqd/112:28:071
679499136,6cyclictest26-21ksoftirqd/109:17:291
6794991311,1cyclictest26-21ksoftirqd/112:24:451
6794991311,1cyclictest23892-21kworker/1:210:27:151
6790991312,0cyclictest25247-21kworker/0:207:57:520
679599128,3cyclictest9431-21kworker/2:108:20:442
679599128,3cyclictest0-21swapper/207:47:282
679599128,3cyclictest0-21swapper/207:18:302
679599122,9cyclictest18635-21kworker/2:207:11:342
6795991212,0cyclictest35-21ksoftirqd/208:31:182
679499129,2cyclictest5262-21systemd11:37:431
679499127,1cyclictest26-21ksoftirqd/110:02:111
6794991210,1cyclictest5241-21kworker/1:110:35:451
6794991210,1cyclictest26-21ksoftirqd/111:50:411
6794991210,1cyclictest26-21ksoftirqd/111:43:001
6794991210,1cyclictest26-21ksoftirqd/110:37:531
6794991210,1cyclictest26-21ksoftirqd/110:08:591
6794991210,1cyclictest0-21swapper/109:42:571
679499120,1cyclictest121rcu_sched10:30:481
679499120,11cyclictest31287-21systemd11:37:151
679499120,11cyclictest31287-21systemd11:37:151
679699119,1cyclictest0-21swapper/308:33:143
679699119,1cyclictest0-21swapper/307:47:563
679699110,1cyclictest0-21swapper/307:54:123
679699110,1cyclictest0-21swapper/307:18:533
679699110,10cyclictest0-21swapper/307:41:393
6795991111,0cyclictest0-21swapper/207:13:082
6795991110,0cyclictest9431-21kworker/2:108:01:202
6795991110,0cyclictest9431-21kworker/2:107:56:182
6795991110,0cyclictest0-21swapper/207:26:502
679499119,1cyclictest8390-21sshd11:27:471
679499119,1cyclictest26-21ksoftirqd/110:20:191
679499117,2cyclictest5135-21sshd10:49:011
679499117,1cyclictest26-21ksoftirqd/111:52:571
679499111,1cyclictest121rcu_sched09:19:491
679499111,1cyclictest121rcu_sched09:19:491
679499110,10cyclictest26813-21systemd12:07:431
679099110,10cyclictest0-21swapper/007:42:530
679699109,0cyclictest0-21swapper/307:32:573
679699108,1cyclictest0-21swapper/308:38:423
679699103,3cyclictest8084-21timerwakeupswit08:07:533
679699101,6cyclictest0-21swapper/307:22:513
679699100,9cyclictest0-21swapper/308:22:053
679699100,9cyclictest0-21swapper/307:16:133
679699100,0cyclictest0-21swapper/308:27:323
679499100,9cyclictest0-21swapper/108:27:331
679499100,9cyclictest0-21swapper/107:24:561
679099109,0cyclictest0-21swapper/007:31:300
679099109,0cyclictest0-21swapper/007:18:090
679099100,9cyclictest0-21swapper/008:16:410
679099100,9cyclictest0-21swapper/007:08:230
679099100,0cyclictest0-21swapper/008:37:500
67969998,0cyclictest0-21swapper/308:16:233
67969998,0cyclictest0-21swapper/307:30:023
67969992,5cyclictest0-21swapper/307:42:463
67969990,5cyclictest0-21swapper/308:57:483
67969990,3cyclictest0-21swapper/308:07:293
67949990,8cyclictest0-21swapper/108:00:011
67949990,0cyclictest0-21swapper/107:44:271
67909998,0cyclictest8565-21kworker/0:108:53:300
67909998,0cyclictest25247-21kworker/0:208:08:160
67909998,0cyclictest0-21swapper/008:22:230
67909990,0cyclictest0-21swapper/007:37:050
67969980,5cyclictest0-21swapper/309:07:293
67969980,5cyclictest0-21swapper/309:07:293
67969980,5cyclictest0-21swapper/307:59:303
67969980,3cyclictest29524-21/usr/sbin/munin08:52:523
67969980,3cyclictest0-21swapper/307:10:553
67969980,2cyclictest14536-21fschecks_count08:22:433
67949987,0cyclictest0-21swapper/108:02:411
67949980,0cyclictest0-21swapper/107:15:531
67949980,0cyclictest0-21swapper/107:07:311
67909980,0cyclictest0-21swapper/008:27:370
67969970,2cyclictest28370-21ntp_states08:47:493
67949976,0cyclictest0-21swapper/108:39:311
67949976,0cyclictest0-21swapper/107:29:491
67949973,2cyclictest0-21swapper/107:17:481
67949972,2cyclictest4813-21latency_hist09:07:291
67949972,2cyclictest4813-21latency_hist09:07:291
67949970,4cyclictest0-21swapper/107:32:451
67949970,1cyclictest806-21nscd08:22:471
67949970,1cyclictest6267-21chrt08:07:311
67949970,1cyclictest5612sleep107:54:451
67949970,1cyclictest29687-21nfsd407:47:501
67949970,1cyclictest28894-21uptime08:47:531
67949970,1cyclictest20395-21ls08:32:481
67949970,1cyclictest13896-21sed08:22:291
67909975,1cyclictest4041-21ls08:02:420
67909970,1cyclictest824-21nscd09:02:400
67909970,1cyclictest824-21nscd09:02:400
67909970,1cyclictest31298-21df07:52:430
67909970,1cyclictest24036-21hddtemp_smartct07:37:450
67909970,1cyclictest15249-21netstat08:22:490
67949964,1cyclictest22854-21kworker/1:207:39:021
67949964,1cyclictest16243-21kworker/1:208:43:541
67949962,2cyclictest0-21swapper/108:52:461
67949960,2cyclictest0-21swapper/108:57:471
67949960,0cyclictest0-21swapper/108:12:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional