You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 18:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sat Nov 15, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2243321510,5sleep3357399cyclictest08:49:083
1773911360,3ptp4l401ktimersoftd/308:13:043
33972704,10sleep00-21swapper/008:13:000
3565996714,11cyclictest13367-21awk13:09:152
3573996623,5cyclictest41-21ksoftirqd/310:38:433
139192640,4sleep213898-21ssh11:14:002
63342630,2sleep00-21swapper/011:44:050
3565996211,16cyclictest6547-21ssh13:02:162
295822610,3sleep1241ktimersoftd/109:04:071
27362610,2sleep10-21swapper/112:57:491
27362610,2sleep10-21swapper/112:57:491
3565996011,18cyclictest19621-21chrt13:17:132
3565996011,17cyclictest19377-21taskset10:39:422
3565996011,15cyclictest6208-21chrt13:37:002
66812590,1sleep00-21swapper/010:24:110
3573995922,8cyclictest41-21ksoftirqd/312:59:503
232362590,4sleep023197-21ssh12:04:080
214852590,5sleep021473-21gltestperf08:48:570
3565995810,11cyclictest5658-21ssh12:23:372
302072580,3sleep0355299cyclictest10:13:590
3565995711,11cyclictest1353-21ssh12:54:472
3565995711,11cyclictest1353-21ssh12:54:472
3565995710,12cyclictest9938-21ssh13:05:552
3565995710,11cyclictest12805-21ssh10:33:262
356599567,10cyclictest7262-21/usr/sbin/munin12:24:032
250362560,4sleep3357399cyclictest08:54:103
357399553,6cyclictest5722-21apt-get12:23:433
3573995525,7cyclictest41-21ksoftirqd/308:48:383
3565995511,14cyclictest2182-21find10:59:062
3565995510,13cyclictest1782-21chrt13:32:382
3565995510,11cyclictest20797-21ssh12:01:482
31302554,40sleep10-21swapper/108:09:301
114102540,1sleep20-21swapper/211:10:022
114102540,1sleep20-21swapper/211:10:022
357399537,9cyclictest41-21ksoftirqd/310:44:083
357399535,9cyclictest41-21ksoftirqd/309:03:393
357399534,7cyclictest41-21ksoftirqd/310:54:013
3573995321,8cyclictest41-21ksoftirqd/312:39:033
3565995310,12cyclictest16667-21ssh11:57:072
248562530,2sleep00-21swapper/010:03:560
357399525,9cyclictest41-21ksoftirqd/311:23:423
357399525,9cyclictest41-21ksoftirqd/310:24:123
357399522,7cyclictest41-21ksoftirqd/311:43:433
3573995224,4cyclictest41-21ksoftirqd/313:39:093
3573995220,9cyclictest41-21ksoftirqd/308:16:113
3573995218,4cyclictest41-21ksoftirqd/313:24:333
3565995210,11cyclictest23123-21ssh10:44:382
3565995210,10cyclictest25658-21ssh12:08:302
357399515,8cyclictest11298-21munin-run08:28:393
357399514,7cyclictest41-21ksoftirqd/312:54:053
357399514,7cyclictest41-21ksoftirqd/312:54:053
357399514,7cyclictest41-21ksoftirqd/309:49:043
357399514,10cyclictest41-21ksoftirqd/312:18:443
3565995111,12cyclictest3551-21ssh11:39:482
3565995110,11cyclictest31772-21taskset10:56:142
3565995110,10cyclictest12702-21ssh12:29:472
202042510,1sleep00-21swapper/011:21:160
357399506,9cyclictest31003-21grep09:08:573
357399505,9cyclictest41-21ksoftirqd/313:09:143
357399504,9cyclictest41-21ksoftirqd/310:18:423
357399503,7cyclictest41-21ksoftirqd/312:28:443
357399503,7cyclictest41-21ksoftirqd/311:49:013
357399503,7cyclictest41-21ksoftirqd/311:44:003
3573995021,9cyclictest41-21ksoftirqd/313:05:543
3573995020,5cyclictest41-21ksoftirqd/313:16:033
357399501,10cyclictest25876-21tune2fs11:29:003
356599509,10cyclictest25802-21ssh12:45:462
356599509,10cyclictest0-21swapper/211:35:002
356599508,19cyclictest29142-21ssh13:27:072
356599508,10cyclictest29139-21diskmemload11:20:042
356599507,11cyclictest18704-21switchtime09:49:102
3565995011,11cyclictest10387-21sh13:40:562
3565995010,17cyclictest7944-21ssh10:26:292
3565995010,12cyclictest5597-21chrt08:15:152
3565995010,12cyclictest18590-21sh12:38:402
3565995010,11cyclictest3230-21sh10:19:572
3565995010,11cyclictest29099-21ssh12:11:432
357399494,9cyclictest41-21ksoftirqd/313:29:023
357399493,7cyclictest41-21ksoftirqd/312:04:033
357399493,7cyclictest41-21ksoftirqd/311:09:003
357399493,7cyclictest41-21ksoftirqd/311:09:003
357399493,7cyclictest13925-21apt-get11:53:583
3573994921,4cyclictest41-21ksoftirqd/311:27:573
357399492,10cyclictest41-21ksoftirqd/309:23:403
357399492,10cyclictest41-21ksoftirqd/309:23:403
3573994920,10cyclictest41-21ksoftirqd/313:21:413
356599499,12cyclictest30299-21sh12:51:362
356599499,12cyclictest30299-21sh12:51:362
3565994910,15cyclictest8944-21ssh11:47:302
3565994910,11cyclictest21740-21sh12:41:372
355299492,6cyclictest22719-21expr09:58:580
357399486,9cyclictest41-21ksoftirqd/309:08:393
357399486,10cyclictest41-21ksoftirqd/311:59:003
357399486,10cyclictest41-21ksoftirqd/310:09:013
357399485,9cyclictest6744-21ssh11:04:153
357399485,9cyclictest6744-21ssh11:04:153
357399485,9cyclictest21776-21apt-get09:58:413
357399483,10cyclictest41-21ksoftirqd/312:44:043
357399483,10cyclictest41-21ksoftirqd/311:33:593
357399482,10cyclictest41-21ksoftirqd/310:48:583
356599489,12cyclictest14060-21tr08:33:532
356599489,11cyclictest0-21swapper/211:06:112
356599489,11cyclictest0-21swapper/211:06:112
356599489,10cyclictest32299-21ssh10:17:012
356599488,9cyclictest22903-21sshd13:19:322
3565994810,12cyclictest27631-21sh11:29:492
3565994810,11cyclictest23918-21sh11:25:252
357399474,9cyclictest41-21ksoftirqd/310:03:593
357399473,7cyclictest41-21ksoftirqd/312:49:073
357399473,7cyclictest41-21ksoftirqd/312:49:073
357399473,6cyclictest227-21systemd-journal11:03:423
357399472,7cyclictest41-21ksoftirqd/313:34:113
357399472,6cyclictest41-21ksoftirqd/310:14:003
3573994721,4cyclictest41-21ksoftirqd/310:31:123
357399471,6cyclictest41-21ksoftirqd/311:13:583
356599479,17cyclictest29970-21chrt09:05:052
356599479,12cyclictest15945-21sh10:36:112
356599478,12cyclictest11459-21sed08:28:392
356599476,12cyclictest27921-21irqstats10:09:012
357399464,9cyclictest17392-21strings08:39:003
357399463,10cyclictest41-21ksoftirqd/309:38:403
357399462,6cyclictest41-21ksoftirqd/309:39:013
357399461,7cyclictest41-21ksoftirqd/312:34:123
357399461,7cyclictest41-21ksoftirqd/309:59:033
356599469,16cyclictest32376-21chrt09:10:352
356599468,13cyclictest21762-21cut08:48:592
356599467,12cyclictest27233-21date08:59:082
357399452,8cyclictest26174-21apt-get12:08:563
357399450,6cyclictest0-21swapper/309:23:533
356599459,15cyclictest27981-21taskset10:51:522
356599459,13cyclictest6036-21munin-node08:18:402
356599459,11cyclictest12974-21sh11:52:262
356599459,11cyclictest1183-21sh12:17:492
356599457,12cyclictest2205-21users09:14:102
355299456,6cyclictest9-21ksoftirqd/012:14:330
357399443,7cyclictest41-21ksoftirqd/309:29:033
357399442,9cyclictest41-21ksoftirqd/312:29:353
357399440,7cyclictest41-21ksoftirqd/309:44:023
357399440,10cyclictest41-21ksoftirqd/309:13:543
356599448,12cyclictest16300-21mailstats09:44:042
357399434,4cyclictest41-21ksoftirqd/310:34:333
357399432,6cyclictest41-21ksoftirqd/308:33:573
3565994314,11cyclictest19879-21ps08:44:032
3565994311,18cyclictest24190-21chrt10:01:452
355299436,9cyclictest9-21ksoftirqd/013:28:590
355299435,8cyclictest9-21ksoftirqd/011:16:050
355299435,7cyclictest9-21ksoftirqd/010:52:260
355299433,6cyclictest9-21ksoftirqd/012:32:300
355299431,7cyclictest25795-21ssh12:45:460
357399422,9cyclictest41-21ksoftirqd/308:18:393
357399422,5cyclictest41-21ksoftirqd/308:28:583
356599428,15cyclictest1760-21runrttasks08:41:192
355299426,7cyclictest9-21ksoftirqd/013:07:280
355299425,7cyclictest9-21ksoftirqd/013:26:270
355299415,7cyclictest9-21ksoftirqd/013:39:410
355299415,7cyclictest9-21ksoftirqd/010:58:230
355299412,6cyclictest9-21ksoftirqd/013:13:580
355299412,6cyclictest0-21swapper/011:12:010
355299412,6cyclictest0-21swapper/011:12:010
356599409,9cyclictest25428-21taskset08:57:472
3565994012,13cyclictest11858-21/usr/sbin/munin08:28:552
355299406,8cyclictest9-21ksoftirqd/009:54:080
355299405,8cyclictest9-21ksoftirqd/013:19:260
355299405,8cyclictest9-21ksoftirqd/011:34:300
355299405,7cyclictest9-21ksoftirqd/012:57:180
355299405,7cyclictest9-21ksoftirqd/012:57:180
355299405,7cyclictest9-21ksoftirqd/012:38:310
355299405,7cyclictest9-21ksoftirqd/011:50:240
355299405,7cyclictest9-21ksoftirqd/008:54:010
355299405,6cyclictest9-21ksoftirqd/012:19:060
355299405,6cyclictest9-21ksoftirqd/011:04:150
355299405,6cyclictest9-21ksoftirqd/011:04:150
356599396,19cyclictest9316-21cat09:29:092
355299395,7cyclictest9-21ksoftirqd/011:31:450
355299395,7cyclictest9-21ksoftirqd/008:33:580
355299395,6cyclictest9-21ksoftirqd/011:25:330
355299394,7cyclictest9-21ksoftirqd/013:37:560
355299394,5cyclictest9-21ksoftirqd/012:25:130
355299394,5cyclictest9-21ksoftirqd/012:02:510
355299393,6cyclictest973-21hddtemp_smartct09:13:570
355299393,4cyclictest9-21ksoftirqd/012:09:520
355299390,36cyclictest101ktimersoftd/008:18:590
355299385,8cyclictest9-21ksoftirqd/008:59:080
355299385,7cyclictest9-21ksoftirqd/011:58:060
355299385,5cyclictest9-21ksoftirqd/011:39:440
355299384,7cyclictest9-21ksoftirqd/012:58:460
355299384,6cyclictest9-21ksoftirqd/013:09:140
355299384,6cyclictest9-21ksoftirqd/010:20:570
355299383,6cyclictest9-21ksoftirqd/010:59:030
356599379,11cyclictest4860-21taskset09:22:352
356599379,11cyclictest4860-21taskset09:22:352
356599377,10cyclictest214752chrt09:54:592
355299375,6cyclictest9-21ksoftirqd/012:42:140
355299375,6cyclictest9-21ksoftirqd/010:29:110
355299374,7cyclictest9-21ksoftirqd/010:38:510
355299373,6cyclictest9-21ksoftirqd/010:44:340
334223716,10sleep20-21swapper/208:12:182
355299365,7cyclictest9-21ksoftirqd/009:48:410
355299365,7cyclictest9-21ksoftirqd/009:23:570
355299365,6cyclictest9-21ksoftirqd/012:51:370
355299365,6cyclictest9-21ksoftirqd/012:51:370
355299364,8cyclictest9-21ksoftirqd/010:34:290
356599358,12cyclictest5445-21cstates09:23:552
355299344,7cyclictest9-21ksoftirqd/009:49:110
355299344,6cyclictest9-21ksoftirqd/008:39:090
355299344,6cyclictest9-21ksoftirqd/008:23:580
356599337,10cyclictest0-21swapper/209:35:062
355299333,6cyclictest9-21ksoftirqd/009:03:520
355299333,5cyclictest9-21ksoftirqd/009:13:270
3552993320,3cyclictest9-21ksoftirqd/008:44:110
355299324,6cyclictest9-21ksoftirqd/009:19:100
355299324,6cyclictest9-21ksoftirqd/009:19:100
356599319,8cyclictest14378-21taskset09:40:162
356599309,11cyclictest24598-21/usr/sbin/munin10:04:132
355299300,7cyclictest9-21ksoftirqd/010:09:120
355299295,6cyclictest9-21ksoftirqd/009:40:190
3559992821,4cyclictest25-21ksoftirqd/111:48:151
3559992821,4cyclictest25-21ksoftirqd/111:27:311
3559992821,4cyclictest25-21ksoftirqd/111:12:141
3559992821,4cyclictest25-21ksoftirqd/111:12:141
355299284,6cyclictest9-21ksoftirqd/008:13:510
355299282,7cyclictest9-21ksoftirqd/009:33:540
144672280,1sleep10-21swapper/112:33:441
3559992721,3cyclictest25-21ksoftirqd/111:56:381
3559992720,4cyclictest25-21ksoftirqd/111:13:581
3559992720,4cyclictest25-21ksoftirqd/108:24:411
355299276,6cyclictest9-21ksoftirqd/009:28:590
45232261,21sleep14623-21/usr/sbin/munin12:59:061
3559992621,3cyclictest25-21ksoftirqd/112:06:461
3559992620,3cyclictest25-21ksoftirqd/108:46:081
3559992619,4cyclictest25-21ksoftirqd/111:53:131
3559992619,4cyclictest25-21ksoftirqd/109:36:511
355299268,3cyclictest9-21ksoftirqd/008:29:400
3559992519,4cyclictest25-21ksoftirqd/108:18:151
3559992519,3cyclictest25-21ksoftirqd/113:13:401
3559992519,3cyclictest25-21ksoftirqd/110:24:481
3559992519,3cyclictest25-21ksoftirqd/110:04:361
3559992519,3cyclictest25-21ksoftirqd/109:50:041
3559992519,3cyclictest25-21ksoftirqd/109:23:481
3559992519,3cyclictest25-21ksoftirqd/109:10:461
3559992518,4cyclictest25-21ksoftirqd/112:43:191
3559992518,4cyclictest25-21ksoftirqd/110:01:281
3559992518,4cyclictest25-21ksoftirqd/109:54:421
3559992418,3cyclictest25-21ksoftirqd/109:13:511
355999240,2cyclictest121rcu_preempt13:31:361
72902230,5sleep17295-21gltestperf08:18:551
3559992318,3cyclictest25-21ksoftirqd/113:34:011
3559992317,3cyclictest25-21ksoftirqd/111:40:561
3559992317,3cyclictest25-21ksoftirqd/110:35:291
3559992317,3cyclictest25-21ksoftirqd/108:41:541
3559992317,3cyclictest25-21ksoftirqd/108:38:241
355999230,2cyclictest121rcu_preempt10:45:071
355999226,13cyclictest1024-21expr10:58:571
3559992218,3cyclictest25-21ksoftirqd/109:43:401
3559992217,3cyclictest25-21ksoftirqd/112:09:001
3559992216,3cyclictest25-21ksoftirqd/112:21:281
3559992216,3cyclictest1503-21grep10:19:001
3559992215,4cyclictest25-21ksoftirqd/111:35:371
355999217,4cyclictest13654-21cron08:33:391
355999213,11cyclictest46950irq/101-ens3-Tx12:13:581
3559992116,3cyclictest25-21ksoftirqd/112:49:041
3559992116,3cyclictest25-21ksoftirqd/112:49:041
3559992116,3cyclictest25-21ksoftirqd/109:20:271
3559992116,3cyclictest25-21ksoftirqd/109:20:271
3559992115,4cyclictest25-21ksoftirqd/112:02:161
3559992115,3cyclictest25-21ksoftirqd/109:43:551
3559992115,3cyclictest25-21ksoftirqd/109:32:411
3559992115,3cyclictest25-21ksoftirqd/109:03:391
355999211,4cyclictest21737-21sed08:48:591
3559992114,5cyclictest25-21ksoftirqd/111:29:001
3559992114,4cyclictest25-21ksoftirqd/108:57:291
3559992113,5cyclictest31163-21timerwakeupswit10:14:101
3559992113,4cyclictest25301-21sh13:23:451
355999210,4cyclictest18917-21grep10:39:101
355999203,14cyclictest15214-21tail12:34:061
3559992015,3cyclictest25-21ksoftirqd/113:26:311
3559992014,3cyclictest25-21ksoftirqd/110:13:361
3559992013,4cyclictest10376-21phc2sys10:29:031
355999201,16cyclictest8480-21ssh12:24:591
355999192,15cyclictest1227-21kworker/1:110:55:521
3559991914,3cyclictest25-21ksoftirqd/110:49:031
3559991913,3cyclictest17444-21bc11:18:541
3559991912,4cyclictest5116-21cpuspeed_turbos11:03:581
3559991912,4cyclictest5116-21cpuspeed_turbos11:03:581
3559991912,4cyclictest24881-21ls12:44:171
3559991813,3cyclictest23986-21kworker/1:013:39:031
3559991812,3cyclictest16697-21basename13:14:051
3559991811,4cyclictest8917-21sh13:04:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional