You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 20:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4.osadl.org (updated Wed Dec 03, 2025 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31813199390,29cyclictest0-21swapper/011:35:340
31813199364,2cyclictest0-21swapper/008:50:170
318131993616,11cyclictest333306-21cron07:25:000
31813999322,3cyclictest464558-21ssh09:25:243
318131993214,9cyclictest667137-21ssh12:06:010
318131993120,10cyclictest0-21swapper/010:14:590
31813999300,21cyclictest0-21swapper/309:56:463
318133993027,2cyclictest354075-21cron07:45:001
318133993027,2cyclictest354075-21cron07:45:001
31813199301,20cyclictest440910-21diskmemload10:50:290
31813199300,20cyclictest553994-21ssh10:37:450
31813199300,1cyclictest542227-21cron10:30:000
31813999290,3cyclictest0-21swapper/309:44:033
318131992918,10cyclictest491917-21ssh09:49:320
31813199291,1cyclictest440910-21diskmemload12:31:040
31813199290,25cyclictest0-21swapper/011:24:110
31813199290,20cyclictest1-21systemd07:30:010
31813999280,3cyclictest50-21ksoftirqd/310:53:153
318131992818,9cyclictest535235-21ssh10:22:440
31813199280,3cyclictest604580-21ssh11:17:210
31813199280,2cyclictest0-21swapper/012:14:150
31813199280,25cyclictest0-21swapper/008:30:120
31813199280,20cyclictest440910-21diskmemload10:05:020
31813199280,1cyclictest0-21swapper/009:32:390
318136992724,2cyclictest401ktimers/212:34:572
31813699272,21cyclictest400399-21apt-get08:30:132
318136992718,7cyclictest628905-21cat11:35:232
31813699270,24cyclictest555218-21apt-config10:40:022
31813699270,20cyclictest191rcu_preempt11:15:312
318131992719,7cyclictest440910-21diskmemload09:24:020
318131992718,8cyclictest431494-21grep09:00:160
318131992717,9cyclictest592248-21udev-worker11:08:130
318131992714,12cyclictest484303-21grep09:40:250
31813199271,21cyclictest440910-21diskmemload11:13:440
31813199271,1cyclictest440910-21diskmemload11:51:250
31813199270,2cyclictest655711-21ssh11:59:400
31813199270,2cyclictest464199-21ld09:25:200
31813199270,26cyclictest0-21swapper/011:34:100
31813199270,19cyclictest0-21swapper/012:22:260
31813199270,19cyclictest0-21swapper/010:48:410
31813999262,22cyclictest637223-21apt-get11:45:133
31813699261,22cyclictest548788-21apt-get10:35:132
31813699261,21cyclictest681726-21apt-get12:20:122
31813699261,21cyclictest349270-21apt-get07:40:122
31813699261,21cyclictest349270-21apt-get07:40:122
318131992619,6cyclictest0-21swapper/012:16:020
318131992618,7cyclictest452645-21chrt09:17:090
31813199261,24cyclictest0-21swapper/009:39:300
31813199261,20cyclictest440910-21diskmemload09:11:410
31813199260,2cyclictest440910-21diskmemload09:50:270
31813199260,25cyclictest0-21swapper/012:28:200
31813199260,25cyclictest0-21swapper/008:25:120
31813199260,24cyclictest440910-21diskmemload12:35:080
31813199260,1cyclictest440910-21diskmemload10:55:320
31813199260,1cyclictest0-21swapper/011:49:120
31813199260,1cyclictest0-21swapper/011:29:370
318139992523,1cyclictest0-21swapper/310:01:493
318136992521,3cyclictest401ktimers/211:50:112
318136992520,3cyclictest561699-21apt-get10:45:132
318136992519,3cyclictest0-21swapper/207:10:122
31813699251,21cyclictest354347-21apt-get07:45:132
31813699251,20cyclictest436081-21apt-get09:05:112
31813699250,23cyclictest509503-21chrt10:00:372
31813699250,21cyclictest0-21swapper/212:35:052
318131992518,6cyclictest0-21swapper/010:40:030
318131992517,7cyclictest547474-21ssh10:31:530
31813199250,24cyclictest440910-21diskmemload10:01:200
31813199250,1cyclictest0-21swapper/012:02:210
31813199250,1cyclictest0-21swapper/011:40:350
31813199250,1cyclictest0-21swapper/011:00:310
31813999243,20cyclictest491ktimers/309:19:023
318139992423,1cyclictest0-21swapper/309:52:173
318139992422,1cyclictest491ktimers/311:42:493
318139992420,3cyclictest648406-21ssh11:51:303
318139992420,2cyclictest649841-21apt-get11:55:133
318139992419,4cyclictest612493-21awk11:25:163
318139992418,5cyclictest662479-21ssh12:05:193
318136992420,2cyclictest536259-21apt-get10:25:132
318136992419,3cyclictest661329-21ssh12:02:302
318136992418,4cyclictest655848-21basename12:00:002
318136992418,2cyclictest574270-21apt-get10:55:122
31813699241,3cyclictest440910-21diskmemload10:17:442
31813699241,3cyclictest440910-21diskmemload10:17:442
31813699241,21cyclictest596844-21kthreadcore11:10:182
31813699241,21cyclictest472376-21apt-get09:35:012
31813699241,21cyclictest394760-21dpkg08:25:002
31813699241,21cyclictest0-21swapper/209:10:132
31813699241,21cyclictest0-21swapper/207:25:132
31813699241,20cyclictest323428-21apt-get07:15:132
31813699241,20cyclictest0-21swapper/209:00:132
31813699240,22cyclictest680856-21ssh12:18:202
31813699240,21cyclictest472745-21latency_hist09:35:012
31813699240,21cyclictest440910-21diskmemload11:30:032
31813699240,21cyclictest440910-21diskmemload10:30:032
31813699240,20cyclictest0-21swapper/209:50:132
31813399242,21cyclictest517461-21apt-get10:10:121
31813399241,21cyclictest630953-21ssh11:40:131
31813399241,21cyclictest511207-21apt-get10:05:131
31813199241,3cyclictest527875-21ssh10:15:230
31813199241,3cyclictest527875-21ssh10:15:230
31813999233,19cyclictest491ktimers/310:05:013
318139992321,1cyclictest0-21swapper/312:04:413
318139992321,1cyclictest0-21swapper/311:20:593
318139992321,1cyclictest0-21swapper/310:25:023
318139992321,1cyclictest0-21swapper/310:11:213
318139992321,1cyclictest0-21swapper/309:39:293
318139992320,2cyclictest529954-21apt-get10:20:113
318139992319,2cyclictest0-21swapper/311:35:163
31813999231,20cyclictest523722-21apt-get10:15:113
31813999231,20cyclictest523722-21apt-get10:15:103
31813999230,3cyclictest693537-21ssh12:28:243
318136992319,3cyclictest634942-21ntpq11:40:212
318136992319,2cyclictest573275-21ssh10:52:502
318136992319,2cyclictest460152-21apt-get09:25:122
318136992318,3cyclictest369559-21apt-get08:00:162
31813699231,2cyclictest440910-21diskmemload12:25:512
31813699231,2cyclictest440910-21diskmemload12:12:112
31813699231,2cyclictest440910-21diskmemload11:02:272
31813699231,2cyclictest440910-21diskmemload10:05:222
31813699231,2cyclictest440910-21diskmemload09:42:562
31813699231,2cyclictest379687-21apt-get08:10:112
31813699231,21cyclictest440910-21diskmemload09:56:262
31813699230,3cyclictest529925-21/usr/sbin/munin10:20:232
31813699230,2cyclictest440910-21diskmemload10:10:442
31813699230,21cyclictest617467-21ssh11:28:172
31813699230,20cyclictest637307-21cpuspeed_turbos11:45:142
318133992318,4cyclictest385254-21irqcore08:15:171
31813399231,2cyclictest584514-21ntpq11:00:221
31813399231,2cyclictest440910-21diskmemload11:36:311
31813399231,2cyclictest440910-21diskmemload10:00:491
31813399231,2cyclictest440910-21diskmemload09:38:201
31813399231,20cyclictest440910-21diskmemload10:31:211
31813399231,20cyclictest425881-21apt-get08:55:121
31813399230,2cyclictest440910-21diskmemload11:12:501
31813399230,21cyclictest395322-21apt-get08:25:121
31813399230,20cyclictest0-21swapper/109:25:111
318131992319,3cyclictest0-21swapper/009:56:460
318131992318,4cyclictest0-21swapper/008:24:160
31813199230,20cyclictest0-21swapper/008:00:150
31813199230,18cyclictest0-21swapper/007:54:100
318139992221,1cyclictest0-21swapper/310:56:543
318139992220,1cyclictest481rcuc/310:49:083
318139992220,1cyclictest0-21swapper/311:10:313
318139992219,2cyclictest669133-21apt-get12:10:143
318139992219,2cyclictest586817-21seq11:05:113
318139992219,2cyclictest481rcuc/310:30:023
31813999221,2cyclictest441639-21hddtemp_smartct09:10:163
31813999221,2cyclictest349270-21apt-get07:40:113
31813999221,2cyclictest349270-21apt-get07:40:113
31813999221,20cyclictest50-21ksoftirqd/311:32:233
31813999221,20cyclictest440910-21diskmemload12:38:523
31813999221,20cyclictest440910-21diskmemload11:16:433
31813999221,20cyclictest394634-21idleruntime-cro08:25:003
31813999221,1cyclictest440910-21diskmemload12:21:373
31813999221,1cyclictest343898-21ls07:35:003
31813999220,3cyclictest481rcuc/310:37:463
31813999220,2cyclictest440910-21diskmemload11:02:433
31813999220,21cyclictest560438-21ssh10:42:033
31813999220,21cyclictest481rcuc/309:49:043
318136992219,2cyclictest440910-21diskmemload09:21:302
318136992218,2cyclictest440910-21diskmemload09:15:072
318136992218,2cyclictest0-21swapper/212:05:182
31813699221,2cyclictest440910-21diskmemload11:20:032
31813699221,2cyclictest0-21swapper/209:47:142
31813699220,2cyclictest0-21swapper/211:06:092
31813699220,21cyclictest64-21kcompactd008:17:172
318133992219,2cyclictest567973-21apt-get10:50:111
318133992219,2cyclictest440910-21diskmemload12:21:091
318133992219,2cyclictest374632-21apt-get08:05:121
318133992219,2cyclictest0-21swapper/112:11:361
318133992218,3cyclictest484623-21ssh09:41:161
318133992216,4cyclictest510-21dbus-daemon08:25:001
31813399221,2cyclictest440910-21diskmemload10:41:331
31813399221,20cyclictest440910-21diskmemload12:07:011
31813399221,20cyclictest410553-21apt-get08:40:111
31813399221,20cyclictest0-21swapper/111:17:281
31813399221,1cyclictest440910-21diskmemload12:19:211
31813399221,1cyclictest440910-21diskmemload09:16:061
31813399220,3cyclictest699242-21ssh12:31:281
31813399220,2cyclictest440910-21diskmemload12:02:091
31813399220,2cyclictest440910-21diskmemload11:58:591
31813399220,2cyclictest440910-21diskmemload11:33:551
31813399220,2cyclictest440910-21diskmemload11:23:551
31813399220,21cyclictest617958-21sh11:29:511
31813399220,20cyclictest440910-21diskmemload09:45:051
31813399220,20cyclictest384487-21cron08:15:001
318131992219,2cyclictest358350-21/usr/sbin/munin07:45:230
31813199220,21cyclictest318349-21apt-get07:10:130
318139992119,1cyclictest481rcuc/309:20:203
318139992119,1cyclictest405477-21apt-get08:35:123
318139992118,2cyclictest699158-21ssh12:31:123
318139992118,2cyclictest440910-21diskmemload12:18:083
318139992118,2cyclictest0-21swapper/307:20:143
318139992117,2cyclictest369276-21cron08:00:003
318139992111,5cyclictest0-21swapper/308:55:183
31813999210,20cyclictest400900-21grep08:30:173
31813999210,20cyclictest0-21swapper/309:30:133
31813999210,20cyclictest0-21swapper/308:50:123
318136992118,2cyclictest0-21swapper/208:40:112
318136992117,3cyclictest364501-21apt-get07:55:122
318136992117,2cyclictest0-21swapper/208:45:132
31813699210,2cyclictest0-21swapper/208:05:122
31813699210,20cyclictest64-21kcompactd008:59:122
318133992119,1cyclictest453854-21ssh09:20:121
318133992119,1cyclictest0-21swapper/111:45:171
318133992119,1cyclictest0-21swapper/110:55:121
318133992119,1cyclictest0-21swapper/110:20:351
318133992119,1cyclictest0-21swapper/107:35:201
318133992118,2cyclictest440910-21diskmemload12:25:041
318133992118,2cyclictest440910-21diskmemload09:31:081
318133992118,2cyclictest323167-21munin-run07:15:001
318133992118,2cyclictest0-21swapper/112:35:121
318133992118,2cyclictest0-21swapper/111:50:191
318133992117,2cyclictest420778-21apt-get08:50:121
31813399211,1cyclictest0-21swapper/109:02:271
31813399211,19cyclictest0-21swapper/110:47:421
31813399210,2cyclictest354846-21grep07:45:171
31813399210,20cyclictest552729-21ssh10:35:211
31813399210,20cyclictest440910-21diskmemload10:15:391
31813399210,20cyclictest440910-21diskmemload10:15:391
31813399210,20cyclictest440910-21diskmemload09:10:141
31813399210,20cyclictest0-21swapper/111:07:161
31813399210,20cyclictest0-21swapper/110:27:151
31813199217,3cyclictest342253-21cut07:30:190
318131992119,1cyclictest379687-21apt-get08:10:120
318131992117,3cyclictest0-21swapper/008:39:200
31813199210,5cyclictest0-21swapper/008:45:120
318139992018,1cyclictest64-21kcompactd007:35:533
318139992018,1cyclictest0-21swapper/309:03:313
31813999201,1cyclictest0-21swapper/307:52:003
31813999200,3cyclictest373472-21sshd08:00:243
31813999200,1cyclictest0-21swapper/307:15:143
31813999200,19cyclictest0-21swapper/309:07:483
318133992018,1cyclictest0-21swapper/109:55:101
318133992018,1cyclictest0-21swapper/108:30:131
31813399200,19cyclictest0-21swapper/109:50:121
31813399200,19cyclictest0-21swapper/107:25:131
31813199207,12cyclictest0-21swapper/007:35:190
31813199202,17cyclictest412792-21kthreadcore08:40:170
31813199201,18cyclictest350222-21sed07:40:180
31813199201,18cyclictest350222-21sed07:40:170
318139991918,1cyclictest0-21swapper/308:05:123
318139991918,0cyclictest0-21swapper/307:10:363
318139991917,1cyclictest0-21swapper/308:10:123
31813999190,1cyclictest0-21swapper/307:26:443
318136991915,2cyclictest405978-21grep08:35:162
318136991915,2cyclictest0-21swapper/208:25:122
318136991913,4cyclictest359423-21apt-get07:50:122
318133991918,1cyclictest64-21kcompactd008:36:371
318133991916,2cyclictest374361-21awk08:05:001
31813199192,15cyclictest384764-21apt-get08:15:120
31813199190,9cyclictest328243-21latency_hist07:20:000
31813999180,7cyclictest389603-21systemd-run08:20:013
318136991816,1cyclictest64-21kcompactd008:54:542
318136991816,1cyclictest0-21swapper/207:37:292
318133991817,1cyclictest0-21swapper/107:50:111
318133991816,1cyclictest0-21swapper/107:55:121
318133991816,1cyclictest0-21swapper/107:22:571
318133991815,2cyclictest420540-21systemd-run08:50:011
318131991812,5cyclictest245621450irq/127-enp0s29f1:rx-007:56:580
318131991811,6cyclictest245622250irq/128-enp0s29f1:tx-008:55:200
318133991715,1cyclictest0-21swapper/107:15:141
31813199171,8cyclictest318161-21ls07:10:000
318131991713,3cyclictest245621450irq/127-enp0s29f1:rx-008:05:120
31813199170,5cyclictest3471731-21systemd-journal09:10:000
318139991614,1cyclictest64-21kcompactd007:47:433
318139991614,1cyclictest481rcuc/308:40:153
318139991614,1cyclictest0-21swapper/308:25:123
31813399160,1cyclictest0-21swapper/107:30:131
318139991512,2cyclictest415830-21fschecks_count08:45:153
318136991513,1cyclictest0-21swapper/207:20:132
318133991511,3cyclictest440511-21unixbench_singl09:05:241
31813699148,3cyclictest343909-21sh07:35:002
31813999110,2cyclictest318063-21latency_hist07:10:013
3181369990,2cyclictest318176-21cat07:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional