You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 23:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1.osadl.org (updated Mon Dec 15, 2025 13:38:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2818721540,2sleep30-21swapper/312:26:533
2818721540,2sleep30-21swapper/312:26:533
853821420,3sleep20-21swapper/207:10:372
853821420,3sleep20-21swapper/207:10:372
638721230,3chrt0-21swapper/308:31:503
638721230,3chrt0-21swapper/308:31:503
239632730,5chrt23965-21grep10:46:541
239632730,5chrt23965-21grep10:46:541
69942620,3sleep10-21swapper/110:01:531
157442560,3sleep20-21swapper/207:30:012
20332530,2sleep01924-21/usr/sbin/munin08:21:440
163832470,3sleep1201rcuc/109:00:011
324192440,3sleep30-21swapper/312:40:033
324192440,3sleep30-21swapper/312:40:033
112662440,4sleep10-21swapper/111:41:511
84742420,2sleep08263-21ls07:10:110
84742420,2sleep08263-21ls07:10:110
306612410,3chrt0-21swapper/111:06:471
203092410,3sleep10-21swapper/110:36:531
82362380,3sleep18540-21cyclictest08:36:511
84822354,25sleep30-21swapper/307:10:183
84822354,25sleep30-21swapper/307:10:183
230932330,2sleep123297-21sed09:16:541
258582320,2sleep225953-21/usr/sbin/munin07:56:512
258582320,2sleep225953-21/usr/sbin/munin07:56:512
116882320,1sleep011689-21sendmail-mta10:16:080
101162310,1sleep1201rcuc/108:41:531
217692290,2sleep121819-21date09:15:011
217692290,2sleep121819-21date09:15:011
127662290,2sleep212894-21sed07:21:472
127662290,2sleep212894-21sed07:21:472
112452290,3sleep10-21swapper/108:46:431
112452290,3sleep10-21swapper/108:46:431
854299289,9cyclictest21-21ksoftirqd/107:24:391
854299289,9cyclictest21-21ksoftirqd/107:24:391
85532270,3chrt0-21swapper/308:36:533
854299278,9cyclictest21-21ksoftirqd/112:39:021
854299278,9cyclictest21-21ksoftirqd/112:39:021
854299277,12cyclictest21-21ksoftirqd/111:51:441
854299277,12cyclictest21-21ksoftirqd/111:51:441
854199277,8cyclictest131rcu_preempt11:11:460
153172270,3sleep30-21swapper/308:56:463
8543992614,9cyclictest26295-21cut10:55:032
854299268,10cyclictest21-21ksoftirqd/107:50:431
854299268,10cyclictest21-21ksoftirqd/107:50:431
8542992613,3cyclictest131rcu_preempt07:36:511
8542992613,3cyclictest131rcu_preempt07:36:511
8541992617,2cyclictest12-21ksoftirqd/009:31:540
8541992617,2cyclictest12-21ksoftirqd/009:31:540
79612260,3sleep00-21swapper/011:31:530
79612260,3sleep00-21swapper/011:31:530
191732260,2sleep2261rcuc/210:36:422
153152260,3sleep30-21swapper/311:51:533
153152260,3sleep30-21swapper/311:51:533
854299255,9cyclictest21-21ksoftirqd/112:11:541
854299255,9cyclictest21-21ksoftirqd/112:11:541
8542992517,6cyclictest201rcuc/112:31:141
8542992517,6cyclictest201rcuc/111:55:181
8542992517,6cyclictest201rcuc/108:20:571
8542992513,3cyclictest131rcu_preempt11:26:311
8542992511,3cyclictest131rcu_preempt11:49:521
854199255,4cyclictest29442-21unixbench_multi11:01:540
854199255,4cyclictest29442-21unixbench_multi11:01:540
8541992511,12cyclictest6996-21proc_pri10:01:530
854199251,10cyclictest19060-21grep12:01:540
854199251,10cyclictest19060-21grep12:01:540
854399241,20cyclictest1669-21ls09:46:542
8543992410,3cyclictest0-21swapper/211:16:532
8543992410,3cyclictest0-21swapper/211:16:532
854299247,9cyclictest21-21ksoftirqd/112:05:341
854299246,4cyclictest131rcu_preempt10:06:451
854299242,5cyclictest21-21ksoftirqd/109:36:461
8542992417,5cyclictest201rcuc/112:23:511
8542992417,5cyclictest201rcuc/110:17:011
8542992417,5cyclictest201rcuc/107:12:541
8542992417,5cyclictest201rcuc/107:12:541
8542992416,6cyclictest201rcuc/110:31:041
8542992411,3cyclictest131rcu_preempt08:30:521
8542992411,3cyclictest131rcu_preempt08:30:521
8542992410,4cyclictest131rcu_preempt09:25:521
8542992410,4cyclictest131rcu_preempt09:25:521
15292240,2sleep30-21swapper/309:46:533
854299239,8cyclictest21-21ksoftirqd/111:11:061
854299237,6cyclictest21-21ksoftirqd/111:20:441
854299237,6cyclictest21-21ksoftirqd/111:20:441
8542992317,4cyclictest201rcuc/111:17:571
8542992317,4cyclictest201rcuc/111:17:571
8542992316,5cyclictest201rcuc/109:49:131
8542992316,5cyclictest201rcuc/107:41:151
854299231,5cyclictest201rcuc/110:58:241
8542992315,6cyclictest201rcuc/108:54:241
854299231,4cyclictest0-21swapper/112:17:491
854299231,19cyclictest8713-21find11:36:431
854299231,19cyclictest8713-21find11:36:431
854299231,16cyclictest6872-21find11:31:431
854299231,16cyclictest6872-21find11:31:431
854299231,16cyclictest0-21swapper/110:27:431
854299231,16cyclictest0-21swapper/110:27:431
8542992311,3cyclictest131rcu_preempt08:01:591
854199234,4cyclictest25224-21kworker/0:009:26:530
854199234,4cyclictest25224-21kworker/0:009:26:530
854199234,3cyclictest131rcu_preempt08:41:550
854199231,4cyclictest131rcu_preempt10:46:540
854199231,4cyclictest131rcu_preempt10:46:540
854199231,19cyclictest11477-21ls08:46:440
854199231,19cyclictest11477-21ls08:46:440
854199231,12cyclictest11064-21grep10:11:530
854199231,12cyclictest11064-21grep10:11:530
243092230,3sleep30-21swapper/312:16:533
854399227,12cyclictest29437-21tail11:01:542
854399227,12cyclictest29437-21tail11:01:542
854299228,6cyclictest21-21ksoftirqd/109:20:381
854299228,6cyclictest21-21ksoftirqd/109:20:381
854299228,4cyclictest21-21ksoftirqd/110:42:511
854299228,4cyclictest21-21ksoftirqd/110:42:511
854299228,4cyclictest21-21ksoftirqd/107:56:481
854299228,4cyclictest21-21ksoftirqd/107:56:481
854299228,3cyclictest131rcu_preempt07:48:381
854299227,8cyclictest21-21ksoftirqd/111:01:371
854299227,8cyclictest21-21ksoftirqd/111:01:371
854299227,6cyclictest21-21ksoftirqd/107:29:041
854299227,3cyclictest131rcu_preempt07:32:571
854299226,6cyclictest131rcu_preempt08:09:541
854299226,6cyclictest131rcu_preempt08:09:541
854299222,5cyclictest21-21ksoftirqd/109:06:471
854299222,5cyclictest21-21ksoftirqd/108:16:491
854299222,5cyclictest21-21ksoftirqd/108:16:491
854299221,18cyclictest10072-21cut10:11:441
854299221,18cyclictest10072-21cut10:11:441
854299221,17cyclictest4390-21find09:56:451
854299221,17cyclictest4390-21find09:56:451
854199221,7cyclictest15667-21fschecks_time10:26:450
854199221,7cyclictest15667-21fschecks_time10:26:450
854199221,4cyclictest131rcu_preempt11:16:500
854199221,4cyclictest131rcu_preempt11:16:500
854199221,18cyclictest722-21find09:46:440
854199221,18cyclictest5588-21find08:31:420
854199221,18cyclictest5588-21find08:31:420
854199221,18cyclictest24977-21ls10:51:460
854199221,12cyclictest18170-21latency_hist09:05:010
854199221,12cyclictest18170-21latency_hist09:05:010
854199221,12cyclictest13618-21ntp_kernel_pll_08:51:490
41332221,17sleep04201-21latency_hist09:55:020
854399217,11cyclictest27936-21systemctl11:00:002
854399211,4cyclictest0-21swapper/212:26:112
854399211,4cyclictest0-21swapper/212:26:112
8543992112,7cyclictest12915-21cat11:46:482
854399211,16cyclictest30909-21grep12:36:442
854399211,16cyclictest30909-21grep12:36:442
854399211,15cyclictest26815-21ls09:26:522
854399211,15cyclictest26815-21ls09:26:522
854399211,14cyclictest16988-21ls07:31:532
854399210,6cyclictest41682sed11:21:542
854399210,6cyclictest41682sed11:21:542
854299219,3cyclictest131rcu_preempt10:51:071
854299218,7cyclictest21-21ksoftirqd/112:03:421
854299218,7cyclictest21-21ksoftirqd/112:03:421
854299216,7cyclictest21-21ksoftirqd/108:12:011
854299212,4cyclictest21-21ksoftirqd/110:21:461
8542992116,3cyclictest201rcuc/109:43:021
8542992116,3cyclictest201rcuc/109:43:021
854299211,5cyclictest21-21ksoftirqd/112:26:491
854299211,5cyclictest21-21ksoftirqd/112:26:491
8542992115,4cyclictest201rcuc/109:53:471
8542992115,4cyclictest201rcuc/109:32:571
8542992115,4cyclictest201rcuc/109:32:571
8542992115,4cyclictest201rcuc/108:27:441
854299211,14cyclictest17207-21ls09:01:471
854299211,14cyclictest17207-21ls09:01:471
854199213,2cyclictest131rcu_preempt12:31:490
854199212,10cyclictest12646-21fschecks_time11:46:460
854199211,5cyclictest25617-21sed12:21:450
8541992115,4cyclictest12-21ksoftirqd/009:41:510
8541992115,4cyclictest12-21ksoftirqd/009:41:510
854199211,11cyclictest20253-21unixbench_multi10:36:530
854199211,10cyclictest8065-21/usr/sbin/munin10:06:510
854199211,10cyclictest5021-21needreboot09:56:510
854199211,10cyclictest5021-21needreboot09:56:510
854199211,10cyclictest3507-21grep11:21:460
854199211,10cyclictest3507-21grep11:21:460
8541992110,9cyclictest0-21swapper/010:31:480
854399209,3cyclictest131rcu_preempt11:41:452
854399208,10cyclictest7959-21unixbench-2d11:31:532
854399208,10cyclictest7959-21unixbench-2d11:31:532
854399201,8cyclictest20125-21latency_hist09:10:032
8543992010,7cyclictest10011-21awk08:41:522
854299209,3cyclictest131rcu_preempt07:18:321
854199201,9cyclictest697-21runrttasks11:41:480
854199201,9cyclictest21182-21grep10:41:450
854199201,9cyclictest21182-21grep10:41:450
854199201,5cyclictest0-21swapper/007:40:030
854199201,5cyclictest0-21swapper/007:40:030
854199201,4cyclictest131rcu_preempt12:26:530
854199201,4cyclictest131rcu_preempt12:26:530
854199201,4cyclictest131rcu_preempt11:06:450
854199201,17cyclictest3755-21/usr/sbin/munin08:26:420
854199201,17cyclictest11374-21ls07:16:510
854199201,16cyclictest25153-21/usr/sbin/munin07:56:460
854199201,16cyclictest25153-21/usr/sbin/munin07:56:460
854199201,11cyclictest697-21runrttasks09:36:020
854199201,10cyclictest697-21runrttasks12:15:370
854199201,10cyclictest23988-21find09:21:430
854199201,10cyclictest23988-21find09:21:430
854199201,10cyclictest20287-21/usr/sbin/munin09:11:430
854199201,10cyclictest20287-21/usr/sbin/munin09:11:430
8541992010,8cyclictest30851-21df_inode12:36:430
8541992010,8cyclictest30851-21df_inode12:36:430
854199200,3cyclictest131rcu_preempt10:56:470
8544991914,3cyclictest72692sleep310:01:553
854399197,10cyclictest7456-21users10:01:562
854399194,4cyclictest131rcu_preempt11:56:442
854399191,7cyclictest350-21head08:16:452
854399191,7cyclictest350-21head08:16:452
8543991913,4cyclictest0-21swapper/209:11:472
8543991913,4cyclictest0-21swapper/209:11:472
8543991912,5cyclictest0-21swapper/210:11:482
8543991912,5cyclictest0-21swapper/210:11:482
854399191,12cyclictest28918-21find12:31:432
854399191,10cyclictest13306-21idleruntime08:51:442
854199193,13cyclictest17655-21latency_hist12:00:010
854199192,3cyclictest131rcu_preempt12:06:460
854199192,14cyclictest14322-21/usr/sbin/munin11:51:430
854199192,14cyclictest14322-21/usr/sbin/munin11:51:430
854199191,4cyclictest131rcu_preempt07:26:450
854199191,2cyclictest131rcu_preempt07:31:440
8541991911,6cyclictest5503-21kernelversion11:26:460
854199191,16cyclictest0-21swapper/008:57:050
854199191,13cyclictest31726-21timerwakeupswit08:11:540
854199191,10cyclictest697-21runrttasks10:21:090
152452190,2sleep319821-21kworker/3:007:26:533
103792190,3sleep20-21swapper/211:40:032
103792190,3sleep20-21swapper/211:40:032
854499181,13cyclictest0-21swapper/310:40:003
854499181,12cyclictest0-21swapper/309:16:533
854399189,7cyclictest15447-21ntpq08:56:482
854399186,10cyclictest31957-21sort11:11:432
854399185,10cyclictest11956-21latency_hist07:20:032
854399184,11cyclictest9760-21latency_hist10:10:032
854399182,13cyclictest21699-21cut07:46:452
854399182,13cyclictest11869-21grep10:16:442
854399181,8cyclictest15724-21grep10:26:462
854399181,8cyclictest15724-21grep10:26:462
854399181,7cyclictest0-21swapper/209:19:252
854399181,15cyclictest3601-21timerwakeupswit09:51:542
8543991811,5cyclictest20189-21sed07:41:462
8543991811,5cyclictest0-21swapper/208:36:472
854399181,14cyclictest30577-21uname11:06:462
854399181,14cyclictest30422-21grep08:10:022
854399181,14cyclictest30422-21grep08:10:022
854399181,13cyclictest6030-21cat10:00:032
854399181,13cyclictest6030-21cat10:00:032
854399181,12cyclictest21730-21grep12:11:452
854399181,12cyclictest21730-21grep12:11:452
854199189,7cyclictest0-21swapper/007:20:290
854199189,7cyclictest0-21swapper/007:20:290
854199183,12cyclictest8173-21grep08:36:500
854199182,8cyclictest19865-21runrttasks09:09:080
854199181,9cyclictest0-21swapper/007:46:520
854199181,7cyclictest9342-21needreboot11:36:490
854199181,7cyclictest9342-21needreboot11:36:490
854199181,2cyclictest131rcu_preempt08:06:510
854199181,2cyclictest131rcu_preempt08:06:510
854199181,15cyclictest0-21swapper/009:16:510
854199181,14cyclictest21731-21cut12:11:450
854199181,14cyclictest21731-21cut12:11:450
8541991810,6cyclictest28105-21grep08:01:540
8541991810,6cyclictest20150-21expr07:41:460
215732180,4sleep30-21swapper/310:41:493
215732180,4sleep30-21swapper/310:41:493
854399177,8cyclictest5320-21fw_packets11:26:442
854399175,10cyclictest2214-21grep08:21:452
854399173,11cyclictest32253-21ls08:15:012
854399172,12cyclictest27939-21gltestperf09:31:452
854399172,12cyclictest27939-21gltestperf09:31:452
854399172,12cyclictest23076-21grep10:46:452
854399172,12cyclictest23076-21grep10:46:452
854399172,12cyclictest17759-21tail09:01:542
854399172,12cyclictest17759-21tail09:01:542
854399171,7cyclictest4996-21runrttasks08:26:592
854399171,4cyclictest131rcu_preempt12:01:532
854399171,4cyclictest131rcu_preempt12:01:532
854399171,14cyclictest14145-21memory10:21:482
8543991711,4cyclictest0-21swapper/212:06:472
854399171,13cyclictest5946-21cut08:31:452
854399171,13cyclictest5946-21cut08:31:452
854399171,13cyclictest32022-21ntp_states09:41:502
854399171,13cyclictest32022-21ntp_states09:41:502
854399171,13cyclictest30599-21sed09:36:542
854399171,13cyclictest24902-21systemctl12:20:002
854399171,13cyclictest18130-21grep07:36:452
854399171,13cyclictest18130-21grep07:36:452
854399171,12cyclictest25952-21ntp_offset12:21:502
854399170,3cyclictest131rcu_preempt09:20:422
854399170,3cyclictest131rcu_preempt09:20:422
854199171,13cyclictest24810-21latency_hist07:55:010
854199171,13cyclictest24810-21latency_hist07:55:010
854199171,13cyclictest1290-21awk08:16:550
854199171,13cyclictest1290-21awk08:16:550
23662170,3sleep30-21swapper/311:16:533
23662170,3sleep30-21swapper/311:16:533
125842171,3sleep20-21swapper/208:49:592
125842171,3sleep20-21swapper/208:49:592
854499161,13cyclictest0-21swapper/311:46:543
854499161,12cyclictest0-21swapper/307:55:033
854499161,12cyclictest0-21swapper/307:55:033
854499161,10cyclictest0-21swapper/308:01:533
8544991610,4cyclictest33-21ksoftirqd/309:36:323
854399162,12cyclictest17536-21fschecks_time10:31:432
854399161,12cyclictest27192-21fschecks_count08:01:452
854399161,12cyclictest23616-21grep07:51:462
854399161,12cyclictest23616-21grep07:51:462
854399161,12cyclictest21174-21grep10:41:452
854399161,12cyclictest21174-21grep10:41:452
854399161,12cyclictest14313-21cpuspeed11:51:432
854399161,12cyclictest14313-21cpuspeed11:51:432
854499159,4cyclictest116572sleep307:16:533
854499151,9cyclictest0-21swapper/309:56:563
854499151,9cyclictest0-21swapper/309:56:563
854499151,9cyclictest0-21swapper/309:26:523
854499151,9cyclictest0-21swapper/309:26:523
854499151,9cyclictest0-21swapper/307:45:013
854499151,12cyclictest0-21swapper/307:36:473
854499151,12cyclictest0-21swapper/307:36:473
854499151,11cyclictest5498-21chrt11:26:463
854499151,10cyclictest0-21swapper/308:20:013
854499151,10cyclictest0-21swapper/308:20:013
8544991510,3cyclictest276132chrt09:31:263
8544991510,3cyclictest276132chrt09:31:263
229942151,3sleep30-21swapper/312:14:243
229942151,3sleep30-21swapper/312:14:243
117952151,3sleep30-21swapper/311:41:583
854499149,4cyclictest33-21ksoftirqd/310:31:573
854499148,4cyclictest33-21ksoftirqd/307:21:593
854499148,4cyclictest33-21ksoftirqd/307:21:593
854499143,6cyclictest0-21swapper/308:26:463
854499141,9cyclictest0-21swapper/311:11:543
854499141,8cyclictest0-21swapper/311:36:433
854499141,8cyclictest0-21swapper/311:36:433
854499141,8cyclictest0-21swapper/310:26:443
854499141,8cyclictest0-21swapper/310:26:443
854499141,8cyclictest0-21swapper/309:11:473
854499141,8cyclictest0-21swapper/309:11:473
854499141,12cyclictest0-21swapper/308:51:463
854499141,10cyclictest32327-21taskset08:15:033
854499138,3cyclictest97982chrt10:10:233
854499138,3cyclictest97982chrt10:10:233
854499138,3cyclictest263992chrt10:56:203
854499138,3cyclictest240632chrt10:47:363
854499138,3cyclictest240632chrt10:47:363
854499138,3cyclictest135552chrt10:21:123
854499137,4cyclictest33-21ksoftirqd/308:24:553
854499133,8cyclictest0-21swapper/307:46:433
854499131,9cyclictest20530-21chrt12:06:523
854499131,9cyclictest18181-21chrt12:01:463
854499131,9cyclictest18181-21chrt12:01:463
854499131,8cyclictest0-21swapper/311:31:473
854499131,8cyclictest0-21swapper/311:31:473
854499131,7cyclictest0-21swapper/312:31:453
854499131,10cyclictest0-21swapper/311:10:023
854499131,10cyclictest0-21swapper/310:06:463
854499131,10cyclictest0-21swapper/308:10:023
854499131,10cyclictest0-21swapper/308:10:023
854499128,3cyclictest254142sleep309:24:273
854499128,3cyclictest254142sleep309:24:273
854499127,4cyclictest33-21ksoftirqd/310:17:593
854499127,3cyclictest312702chrt09:41:023
854499127,3cyclictest312702chrt09:41:023
854499127,3cyclictest31042chrt11:20:233
854499127,3cyclictest31042chrt11:20:233
854499126,4cyclictest33-21ksoftirqd/307:31:393
854499123,7cyclictest0-21swapper/310:51:463
854499121,9cyclictest9725-21chrt08:41:473
854499121,9cyclictest3775-21taskset09:51:553
854499121,9cyclictest26620-21chrt12:23:323
854499121,9cyclictest16744-21chrt09:01:443
854499121,9cyclictest16744-21chrt09:01:443
854499116,3cyclictest109832chrt08:45:133
854499116,3cyclictest109832chrt08:45:133
854499111,8cyclictest28160-21chrt11:00:103
854499111,8cyclictest28160-21chrt11:00:103
854499111,8cyclictest25081-21chrt07:55:503
854499111,8cyclictest25081-21chrt07:55:503
854499111,8cyclictest18365-21chrt09:05:383
854499111,8cyclictest15939-21chrt11:55:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional