You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-27 - 01:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot4.osadl.org (updated Mon Feb 26, 2024 12:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18618172299259,26sleep10-21swapper/107:09:471
18616282269182,20sleep00-21swapper/007:07:480
159199540,4rtkit-daemon1590-21rtkit-daemon12:10:041
159199510,15rtkit-daemon1924404-21kworker/u8:309:30:271
20490702490,4sleep00-21swapper/012:30:390
159199460,3rtkit-daemon0-21swapper/007:14:430
19702432440,1sleep01970244-21ssh10:34:570
1861979994428,8cyclictest2017717-21sh11:45:001
159199430,3rtkit-daemon0-21swapper/108:47:560
159199430,3rtkit-daemon0-21swapper/007:56:360
159199400,3rtkit-daemon0-21swapper/011:00:170
159199400,29rtkit-daemon2020469-21ssh11:48:461
159199390,8rtkit-daemon0-21swapper/110:34:351
159199390,3rtkit-daemon0-21swapper/010:58:590
186197999386,3cyclictest141rcu_preempt11:15:271
186197999383,2cyclictest141rcu_preempt11:35:001
186197699389,17cyclictest13-21ksoftirqd/012:00:030
1861976993812,8cyclictest63950irq/130-enp2s011:15:220
1861979993722,6cyclictest1982599-21sh10:51:281
186197999364,4cyclictest0-21swapper/110:48:431
1861979993621,9cyclictest2038086-21cpu12:15:201
1861976993627,4cyclictest2034900-21taskset12:10:210
186197999359,2cyclictest141rcu_preempt11:25:011
186197999353,4cyclictest0-21swapper/112:30:451
186197699355,1cyclictest141rcu_preempt10:45:330
186197999348,3cyclictest0-21swapper/111:12:411
186197999345,2cyclictest141rcu_preempt11:35:031
1861979993417,3cyclictest0-21swapper/112:20:321
1861979993415,11cyclictest1915338-1kworker/u9:010:15:221
1861979993412,3cyclictest0-21swapper/112:35:351
186197999340,23cyclictest2028191-21gdbus12:00:041
186197699347,12cyclictest13-21ksoftirqd/011:05:330
186197999338,3cyclictest0-21swapper/112:25:471
186197999332,3cyclictest141rcu_preempt11:25:281
1861979993315,13cyclictest1977185-21ssh10:44:581
1861979993311,2cyclictest0-21swapper/111:00:011
1861976993320,3cyclictest2042751-21users12:20:370
1861976993315,7cyclictest3372530-21gmain12:20:010
1861976993312,5cyclictest13-21ksoftirqd/011:55:000
186197699330,11cyclictest13-21ksoftirqd/011:35:010
159199330,8rtkit-daemon2021894-21needreboot11:50:291
159199330,4rtkit-daemon1590-21rtkit-daemon08:21:361
1861979993215,2cyclictest20323932chrt12:05:331
1861979993211,2cyclictest0-21swapper/111:02:441
1861979993210,2cyclictest141rcu_preempt12:00:001
186197699326,4cyclictest13-21ksoftirqd/010:45:020
1861979993115,8cyclictest1993328-21ssh11:07:351
186197699318,5cyclictest2032900-21unixbench_singl12:05:380
186197699317,9cyclictest13-21ksoftirqd/011:23:330
186197699314,14cyclictest1994534-21apt-get11:10:220
186197699313,11cyclictest13-21ksoftirqd/012:40:010
186197699312,6cyclictest2029007-21wc12:00:310
1861976993123,2cyclictest2004712-21sort11:25:270
1861976993121,4cyclictest2010783-21python311:35:020
1861976993114,4cyclictest2015497-21missed_timers11:40:280
1861976993113,5cyclictest1982055-21timerandwakeup10:50:380
159199310,4rtkit-daemon1590-21rtkit-daemon08:33:471
159199300,4rtkit-daemon1590-21rtkit-daemon08:18:290
1861979992914,2cyclictest0-21swapper/107:29:191
186197699299,8cyclictest13-21ksoftirqd/009:00:440
1861976992922,2cyclictest2045048-21sed12:25:270
1861976992910,8cyclictest13-21ksoftirqd/007:32:580
186197699289,5cyclictest2018594-21latency11:45:260
1861976992816,6cyclictest3372530-21gmain10:05:190
1861976992810,16cyclictest19331272sleep009:40:300
186197699278,10cyclictest0-21swapper/007:29:480
186197699274,3cyclictest141rcu_preempt09:56:320
1861976992713,9cyclictest1963578-21apt-get10:25:200
159199270,7rtkit-daemon420575-21snmpd08:03:520
186197999261,9cyclictest1973827-21sendmail-msp10:40:001
186197999261,8cyclictest1909898-21diskmemload09:14:521
186197699268,4cyclictest0-21swapper/009:50:260
186197699267,5cyclictest13-21ksoftirqd/007:17:320
186197699264,8cyclictest13-21ksoftirqd/008:24:420
1861976992617,7cyclictest1866821-21diskstats07:20:250
1861976992615,6cyclictest63950irq/130-enp2s010:10:190
1861976992613,8cyclictest63950irq/130-enp2s009:45:200
186197999252,4cyclictest0-21swapper/107:33:391
1861976992513,7cyclictest63950irq/130-enp2s009:10:180
186197699251,19cyclictest1928604-21apt-get09:35:200
1861976992511,3cyclictest1909898-21diskmemload10:15:040
186197999247,2cyclictest141rcu_preempt09:25:351
186197999242,16cyclictest1886638-21apt-get08:10:201
186197999242,15cyclictest1908165-21apt-get09:05:241
1861976992412,7cyclictest63950irq/130-enp2s010:35:210
1861976992411,3cyclictest1909898-21diskmemload09:16:140
186197999232,15cyclictest1892514-21apt-get08:25:221
1861979992315,6cyclictest1863831-21cron07:14:591
186197699232,15cyclictest1924980-21apt-get09:30:290
1861976992313,2cyclictest13-21ksoftirqd/008:30:110
1861976992312,7cyclictest63950irq/130-enp2s009:25:230
1861976992310,8cyclictest1878768-21apt-get07:50:200
159199230,4rtkit-daemon1955270-21ssh10:12:391
159199230,3rtkit-daemon0-21swapper/007:39:070
186197999223,12cyclictest1872902-21apt-get07:35:231
186197999223,11cyclictest1906207-21apt-get09:00:181
186197999222,14cyclictest1902294-21apt-get08:50:241
186197999222,14cyclictest1882738-21apt-get08:00:201
186197999222,14cyclictest1876823-21apt-get07:45:231
186197999222,13cyclictest1900343-21apt-get08:45:211
186197999222,13cyclictest1898389-21apt-get08:40:181
186197999221,2cyclictest0-21swapper/107:41:271
186197999220,5cyclictest1940444-21tail09:50:351
186197999220,4cyclictest991803-1kworker/1:0H09:20:011
186197999220,20cyclictest1938660-21ssh09:49:361
186197699226,2cyclictest13-21ksoftirqd/007:44:190
186197699222,14cyclictest1896420-21apt-get08:35:210
1861976992216,4cyclictest1904525-21seq08:55:290
186197999212,13cyclictest1946234-21apt-get10:00:221
186197999212,13cyclictest1888590-21apt-get08:15:211
186197999212,13cyclictest1884688-21apt-get08:05:201
1861979992113,6cyclictest1897937-21seq08:37:501
1861979992112,4cyclictest4173779-21snapd07:16:261
186197699217,4cyclictest3372530-21gmain08:54:310
186197699212,2cyclictest141rcu_preempt08:15:010
1861976992115,4cyclictest420575-21snmpd07:47:280
1861976992113,6cyclictest1894086-21seq08:28:270
1861976992110,6cyclictest63950irq/130-enp2s010:20:230
159199210,13rtkit-daemon0-21swapper/109:41:141
186197999204,9cyclictest1917638-21apt-get09:20:181
186197999203,11cyclictest1880771-21apt-get07:55:211
186197999203,10cyclictest1880185-21apt-get07:51:351
186197999202,13cyclictest1904245-21apt-get08:55:241
1861979992014,4cyclictest26-21ksoftirqd/110:30:001
186197999201,14cyclictest4173782-21snapd07:21:561
186197999201,14cyclictest1949551-21/usr/sbin/munin10:05:371
186197699207,1cyclictest0-21swapper/008:42:470
1861976992012,6cyclictest1885457-21seq08:05:310
1861976992011,7cyclictest673-21dbus-daemon10:00:340
186197999192,15cyclictest26-21ksoftirqd/109:55:231
1861979991911,5cyclictest1909898-21diskmemload10:20:041
1861976991914,3cyclictest63950irq/130-enp2s009:21:570
186197999182,11cyclictest1928583-21/usr/sbin/munin09:35:381
186197699180,2cyclictest141rcu_preempt09:05:290
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional