You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 10:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack4slot1.osadl.org (updated Fri Apr 17, 2026 22:31:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2782324130,1sleep121-21ksoftirqd/119:12:321
2782324130,1sleep121-21ksoftirqd/119:12:321
2754721370,4sleep227536-21find21:32:232
2580621300,1sleep012-21ksoftirqd/020:32:230
2580621300,1sleep012-21ksoftirqd/020:32:230
2436021180,2sleep30-21swapper/321:29:093
2436021180,2sleep30-21swapper/321:29:093
2436021180,2sleep30-21swapper/321:29:093
2946521060,3sleep129466-21sshd19:17:231
2946521060,3sleep129466-21sshd19:17:231
2946521060,3sleep129466-21sshd19:17:231
2896021030,3sleep228786-21/usr/sbin/munin22:07:122
2009521030,5sleep220089-21find20:17:222
2009521030,5sleep220089-21find20:17:222
2009521030,5sleep220089-21find20:17:222
298982970,3sleep129894-21ssh22:07:231
298982970,3sleep129894-21ssh22:07:231
200802960,1sleep012-21ksoftirqd/021:57:210
200802960,1sleep012-21ksoftirqd/021:57:210
124412740,2sleep20-21swapper/219:57:242
124412740,2sleep20-21swapper/219:57:242
100842650,3chrt0-21swapper/019:52:140
202932640,2chrt0-21swapper/222:32:042
202932640,2chrt0-21swapper/222:32:042
202932640,2chrt0-21swapper/222:32:042
111342590,3sleep30-21swapper/319:55:393
272192580,2sleep027270-21ps19:12:190
272192580,2sleep027270-21ps19:12:190
217532570,2sleep021811-21ps20:22:190
217532570,2sleep021811-21ps20:22:190
54272550,1sleep017159-21snmpd21:04:280
54272550,1sleep017159-21snmpd21:04:280
54272550,1sleep017159-21snmpd21:04:280
98422490,4chrt0-21swapper/222:20:182
98422490,4chrt0-21swapper/222:20:182
98422490,4chrt0-21swapper/222:20:182
151472480,2sleep00-21swapper/021:19:340
151472480,2sleep00-21swapper/021:19:340
140632480,3chrt0-21swapper/121:18:101
140632480,3chrt0-21swapper/121:18:101
324882460,3sleep20-21swapper/219:27:122
324882460,3sleep20-21swapper/219:27:122
284362460,3sleep20-21swapper/222:06:552
284362460,3sleep20-21swapper/222:06:552
271382460,2sleep30-21swapper/322:04:513
271382460,2sleep30-21swapper/322:04:513
271382460,2sleep30-21swapper/322:04:513
65602450,3sleep05856-21/usr/sbin/munin21:07:160
65602450,3sleep05856-21/usr/sbin/munin21:07:160
65602450,3sleep05856-21/usr/sbin/munin21:07:160
186812440,3chrt0-21swapper/022:29:370
186812440,3chrt0-21swapper/022:29:370
186812440,3chrt0-21swapper/022:29:370
179982440,2sleep30-21swapper/320:12:203
108132440,3sleep10-21swapper/121:47:411
108132440,3sleep10-21swapper/121:47:411
108132440,3sleep10-21swapper/121:47:411
273272420,2sleep226291-21ls19:12:212
273272420,2sleep226291-21ls19:12:212
118322420,3sleep30-21swapper/322:22:123
118322420,3sleep30-21swapper/322:22:123
282602410,4sleep00-21swapper/022:06:370
282602410,4sleep00-21swapper/022:06:370
282602410,4sleep00-21swapper/022:06:370
27870994124,6cyclictest20089-21find20:17:211
27870994124,6cyclictest20089-21find20:17:211
27870994124,6cyclictest20089-21find20:17:211
51212400,3sleep20-21swapper/219:38:222
51212400,3sleep20-21swapper/219:38:222
306332390,5sleep30-21swapper/320:47:103
40082380,3sleep30-21swapper/321:41:363
40082380,3sleep30-21swapper/321:41:363
80452370,2sleep18149-21missed_timers19:47:141
80452370,2sleep18149-21missed_timers19:47:141
27872993610,22cyclictest0-21swapper/319:57:243
27872993610,22cyclictest0-21swapper/319:57:243
2787099361,10cyclictest9470-21fschecks_count21:47:121
2787099351,9cyclictest21960-21sensors_temp20:22:211
2787099351,9cyclictest21960-21sensors_temp20:22:211
27870993518,7cyclictest374-21find21:37:231
27870993518,7cyclictest374-21find21:37:231
29812340,2sleep22995-21ssh21:40:242
29812340,2sleep22995-21ssh21:40:242
27870993410,21cyclictest20571-21ssh22:32:111
27870993410,21cyclictest20571-21ssh22:32:111
2787299339,19cyclictest0-21swapper/319:17:223
2787299339,19cyclictest0-21swapper/319:17:223
2787299339,19cyclictest0-21swapper/319:17:223
2787099339,21cyclictest24376-21latency_hist22:02:091
2787099339,21cyclictest24376-21latency_hist22:02:091
2787099331,7cyclictest5583-21ssh22:16:421
2787099331,7cyclictest5583-21ssh22:16:421
12152330,3chrt0-21swapper/021:38:030
12152330,3chrt0-21swapper/021:38:030
2787299321,28cyclictest0-21swapper/320:02:113
2787299321,28cyclictest0-21swapper/320:02:113
2787099321,9cyclictest6405-21ntp_states19:42:171
2787099321,9cyclictest6405-21ntp_states19:42:171
2787099321,9cyclictest2440-21ntp_kernel_err19:32:161
2787099321,9cyclictest23655-21ssh21:28:011
2787099321,9cyclictest23655-21ssh21:28:011
2787099321,9cyclictest23655-21ssh21:28:011
2787099321,8cyclictest7514-21sshd21:11:221
2787099321,8cyclictest7514-21sshd21:11:221
2787099321,8cyclictest7514-21sshd21:11:221
2787099321,8cyclictest10082-21/usr/sbin/munin19:52:141
2787099321,7cyclictest11686-21taskset21:16:401
2787099321,7cyclictest11686-21taskset21:16:401
2787099321,6cyclictest16457-21ssh21:54:101
2787099321,6cyclictest16457-21ssh21:54:101
2787099321,6cyclictest11952-21cat22:22:131
2787099321,6cyclictest11952-21cat22:22:131
2787099321,10cyclictest695-21runrttasks22:06:371
2787099321,10cyclictest695-21runrttasks22:06:371
2787099321,10cyclictest695-21runrttasks22:06:371
2787099321,10cyclictest30737-21sort20:47:101
27869993226,4cyclictest30381-1kworker/0:0H19:42:150
27869993226,4cyclictest30381-1kworker/0:0H19:42:150
182442320,3sleep10-21swapper/121:22:201
182442320,3sleep10-21swapper/121:22:201
182442320,3sleep10-21swapper/121:22:201
174422320,3chrt0-21swapper/322:27:393
174422320,3chrt0-21swapper/322:27:393
174422320,3chrt0-21swapper/322:27:393
2787299311,26cyclictest149042sleep321:19:173
2787299311,26cyclictest149042sleep321:19:173
2787099316,4cyclictest7094-21ssh21:44:051
2787099313,5cyclictest18107-21wc20:12:211
2787099312,4cyclictest0-21swapper/120:07:211
2787099312,11cyclictest695-21runrttasks21:35:301
2787099311,9cyclictest14469-21cat20:02:221
2787099311,9cyclictest14469-21cat20:02:221
2787099311,8cyclictest5004-21users19:37:241
2787099311,8cyclictest5004-21users19:37:241
2787099311,8cyclictest4553-21needreboot21:02:151
2787099311,8cyclictest4553-21needreboot21:02:151
2787099311,8cyclictest4553-21needreboot21:02:151
2787099311,7cyclictest26934-21sort20:37:121
2787099311,7cyclictest26934-21sort20:37:121
2787099311,10cyclictest6851-21rm22:17:161
2787099311,10cyclictest6851-21rm22:17:161
2787099311,10cyclictest6851-21rm22:17:161
2787099311,10cyclictest16931-21switchtime22:27:211
2787099311,10cyclictest11873-21irqstats19:57:141
2787099311,10cyclictest11873-21irqstats19:57:141
2787099310,7cyclictest1380-21taskset19:29:321
2787099310,7cyclictest1380-21taskset19:29:321
2787099301,9cyclictest695-21runrttasks20:56:181
2787099301,9cyclictest695-21runrttasks20:32:151
2787099301,9cyclictest695-21runrttasks20:32:151
2787099301,7cyclictest30982-21/usr/sbin/munin19:22:131
2787099301,7cyclictest30982-21/usr/sbin/munin19:22:131
2787099301,7cyclictest30982-21/usr/sbin/munin19:22:131
2787099301,7cyclictest2296-21/usr/sbin/munin20:57:121
2787099301,7cyclictest2296-21/usr/sbin/munin20:57:121
2787099301,10cyclictest24839-21latency_hist20:32:081
2787299291,25cyclictest25800-21taskset20:32:223
2787299291,25cyclictest25800-21taskset20:32:223
2787299291,23cyclictest2439-21chrt19:32:163
27871992920,7cyclictest2945-21find20:57:212
27871992920,7cyclictest2945-21find20:57:212
2787099291,7cyclictest10323-21systemd-journal20:27:441
2787099291,7cyclictest10323-21systemd-journal20:27:441
2787099291,10cyclictest28936-21fschecks_time20:42:121
27869992913,8cyclictest12-21ksoftirqd/022:22:000
27869992913,8cyclictest12-21ksoftirqd/022:22:000
27869992913,8cyclictest12-21ksoftirqd/022:22:000
2787299286,19cyclictest0-21swapper/320:07:143
2787299281,24cyclictest7406-21chrt21:10:123
2787299281,24cyclictest7406-21chrt21:10:123
2787299281,24cyclictest7406-21chrt21:10:123
2787299281,24cyclictest73352sleep319:46:273
2787299281,24cyclictest73352sleep319:46:273
2787299281,24cyclictest36192chrt21:01:123
2787299281,24cyclictest36192chrt21:01:123
2787299281,24cyclictest28038-21chrt19:14:433
2787299281,24cyclictest28038-21chrt19:14:433
2787299281,24cyclictest20751-21chrt21:25:363
2787299281,24cyclictest20751-21chrt21:25:363
2787299281,24cyclictest20751-21chrt21:25:363
2787299281,24cyclictest1448-21taskset20:53:123
27871992812,6cyclictest1972-21ssh22:12:222
27871992812,6cyclictest1972-21ssh22:12:222
2787099281,10cyclictest31287-21grep20:47:161
27869992812,5cyclictest12-21ksoftirqd/021:32:220
81012270,3sleep30-21swapper/322:18:063
81012270,3sleep30-21swapper/322:18:063
81012270,3sleep30-21swapper/322:18:063
2787299271,23cyclictest5314-21chrt19:40:323
2787299271,23cyclictest5314-21chrt19:40:323
2787299271,23cyclictest29147-21chrt21:34:093
2787299271,23cyclictest1367-21chrt19:29:223
2787299271,23cyclictest1367-21chrt19:29:223
2787299271,23cyclictest12041-21chrt21:49:403
2787299271,23cyclictest12041-21chrt21:49:403
2787299271,23cyclictest12041-21chrt21:49:403
2787299271,22cyclictest295122sleep322:07:173
2787299271,22cyclictest295122sleep322:07:173
2787299271,22cyclictest28147-21chrt20:38:493
2787299271,22cyclictest28147-21chrt20:38:493
2787299271,22cyclictest22410-21chrt20:23:093
2787299271,22cyclictest22410-21chrt20:23:093
2787299271,22cyclictest17444-21chrt21:55:273
2787299271,22cyclictest17444-21chrt21:55:273
27869992718,3cyclictest141rcub/019:57:230
27869992718,3cyclictest141rcub/019:57:230
27869992714,11cyclictest38750irq/56-eth021:27:120
2787299268,15cyclictest0-21swapper/321:57:223
2787299268,15cyclictest0-21swapper/321:57:223
2787299261,23cyclictest5265-21chrt21:02:373
2787299261,23cyclictest5265-21chrt21:02:373
2787299261,23cyclictest5265-21chrt21:02:373
2787299261,22cyclictest31979-21chrt20:48:173
2787299261,22cyclictest244642sleep320:30:333
2787299261,22cyclictest244642sleep320:30:333
2787299261,22cyclictest244642sleep320:30:333
2787299261,22cyclictest20689-21chrt20:20:483
2787299261,22cyclictest20689-21chrt20:20:483
2787299261,22cyclictest20689-21chrt20:20:483
2787299261,21cyclictest3660-21taskset22:14:133
2787299261,21cyclictest3660-21taskset22:14:133
2787299261,21cyclictest296892sleep320:42:223
2787299261,21cyclictest10487-21chrt21:14:343
2787299261,21cyclictest10487-21chrt21:14:343
27869992621,3cyclictest11877-21latency_hist21:16:590
27869992621,3cyclictest11877-21latency_hist21:16:590
27869992613,10cyclictest10323-21systemd-journal19:41:590
27869992613,10cyclictest10323-21systemd-journal19:41:590
2787299258,15cyclictest0-21swapper/319:22:163
2787299258,15cyclictest0-21swapper/319:22:163
2787299258,15cyclictest0-21swapper/319:22:163
2787299251,21cyclictest90242chrt19:48:523
2787299251,21cyclictest90242chrt19:48:523
2787299251,21cyclictest6738-21taskset21:43:293
2787299251,21cyclictest6738-21taskset21:43:293
27871992510,4cyclictest27-21ksoftirqd/220:47:212
2786999257,5cyclictest38750irq/56-eth022:22:170
2786999257,5cyclictest38750irq/56-eth022:22:170
27869992516,6cyclictest18731-21sh21:22:240
27869992516,6cyclictest18731-21sh21:22:240
2786999251,18cyclictest13894-21ls21:52:110
2786999251,18cyclictest13894-21ls21:52:110
27869992510,3cyclictest12-21ksoftirqd/021:27:220
27869992510,3cyclictest12-21ksoftirqd/021:27:220
27869992510,3cyclictest12-21ksoftirqd/021:27:220
2786999250,5cyclictest131rcu_preempt20:57:220
2786999250,5cyclictest131rcu_preempt20:57:220
27871992314,6cyclictest18728-21users21:22:242
27871992314,6cyclictest18728-21users21:22:242
27871992314,6cyclictest18728-21users21:22:242
2787199231,19cyclictest4109-21fschecks_count21:02:122
2787199231,19cyclictest4109-21fschecks_count21:02:122
2787199231,19cyclictest4109-21fschecks_count21:02:122
2786999239,3cyclictest12-21ksoftirqd/019:32:210
27869992318,3cyclictest30381-1kworker/0:0H19:47:220
27869992318,3cyclictest30381-1kworker/0:0H19:47:220
2786999231,16cyclictest9016-21ls21:47:020
2786999231,16cyclictest9016-21ls21:47:020
139822230,3sleep20-21swapper/222:24:202
139822230,3sleep20-21swapper/222:24:202
2787199222,5cyclictest12317-21cut21:17:122
2787199222,5cyclictest12317-21cut21:17:122
2787199222,18cyclictest23241-21unixbench_singl21:27:242
2787199222,18cyclictest23241-21unixbench_singl21:27:242
2787199222,18cyclictest23241-21unixbench_singl21:27:242
2787199221,19cyclictest21269-21fschecks_count20:22:122
2787199221,19cyclictest21269-21fschecks_count20:22:122
2787199221,18cyclictest9796-21fschecks_time19:52:122
2787199220,4cyclictest25797-21find20:32:232
2787199220,4cyclictest25797-21find20:32:232
2786999222,17cyclictest23995-21timerwakeupswit20:27:210
2786999222,17cyclictest23995-21timerwakeupswit20:27:210
2786999222,17cyclictest23995-21timerwakeupswit20:27:210
27869992215,6cyclictest73-21kswapd020:02:220
27869992215,6cyclictest73-21kswapd020:02:220
2787199212,17cyclictest29047-21fschecks_count22:07:122
2787199212,17cyclictest29047-21fschecks_count22:07:122
2787199212,17cyclictest1225-21grep20:52:212
2787199212,16cyclictest5908-21fschecks_count19:42:122
2787199212,16cyclictest5908-21fschecks_count19:42:122
2787199212,16cyclictest30521-21cat20:47:042
2787199212,16cyclictest30521-21cat20:47:042
2787199212,16cyclictest19318-21fschecks_time21:57:112
2787199212,16cyclictest19318-21fschecks_time21:57:112
2787199212,12cyclictest17316-21latency_hist21:22:082
2787199212,12cyclictest17316-21latency_hist21:22:082
27871992115,4cyclictest17012-21ssh21:54:532
27871992115,4cyclictest17012-21ssh21:54:532
2787199211,18cyclictest7596-21ls21:11:592
2787199211,18cyclictest7596-21ls21:11:592
2787199211,18cyclictest7596-21ls21:11:592
2787199211,18cyclictest27677-21wc20:37:212
2787199211,18cyclictest27677-21wc20:37:212
2787199211,18cyclictest17783-21needreboot20:12:152
2786999213,16cyclictest2250-21users22:12:250
2786999213,16cyclictest2250-21users22:12:250
2786999212,17cyclictest32763-21fschecks_time20:52:090
2786999212,17cyclictest27923-21unixbench_multi20:37:240
2786999212,17cyclictest27923-21unixbench_multi20:37:240
2786999212,16cyclictest9774-21latency21:47:140
2786999212,16cyclictest19457-21gltestperf20:17:110
2786999212,16cyclictest19457-21gltestperf20:17:110
2786999212,16cyclictest19457-21gltestperf20:17:110
2786999211,11cyclictest14021-21fschecks_time21:52:130
2786999211,11cyclictest14021-21fschecks_time21:52:130
96962200,3sleep20-21swapper/221:47:142
96962200,3sleep20-21swapper/221:47:142
96962200,3sleep20-21swapper/221:47:142
2787199202,16cyclictest30723-21fschecks_time19:22:112
2787199202,16cyclictest30723-21fschecks_time19:22:112
2787199202,16cyclictest30723-21fschecks_time19:22:112
27871992013,5cyclictest0-21swapper/220:07:062
27871992013,5cyclictest0-21swapper/220:07:062
2787199201,16cyclictest9489-21cut21:47:122
2786999208,4cyclictest38750irq/56-eth022:10:310
2786999208,4cyclictest38750irq/56-eth022:10:310
2786999203,15cyclictest29000-21fschecks_time20:42:130
2786999203,15cyclictest29000-21fschecks_time20:42:130
2786999201,11cyclictest29002-21memory19:17:150
2786999201,11cyclictest29002-21memory19:17:150
2786999201,11cyclictest29002-21memory19:17:150
2787199193,14cyclictest3497-21grep19:36:592
2787199192,15cyclictest15759-21latency20:07:132
2787199191,16cyclictest7914-21fschecks_time19:47:112
2787199191,16cyclictest7914-21fschecks_time19:47:112
2787199191,16cyclictest4828-21fschecks_count21:42:112
2787199191,16cyclictest28780-21fschecks_time19:17:122
2787199191,16cyclictest28780-21fschecks_time19:17:122
2787199191,16cyclictest28780-21fschecks_time19:17:122
2786999192,15cyclictest32641-21fschecks_time19:27:130
2786999192,15cyclictest32641-21fschecks_time19:27:130
2786999192,15cyclictest15552-21fschecks_time20:07:110
2786999191,10cyclictest695-21runrttasks20:49:130
2787199183,13cyclictest23525-21tail20:27:142
2787199183,13cyclictest23525-21tail20:27:142
2787199183,13cyclictest23525-21tail20:27:142
2786999185,11cyclictest31272-21sendmail_mailst19:22:190
2786999185,11cyclictest31272-21sendmail_mailst19:22:190
2786999185,11cyclictest31272-21sendmail_mailst19:22:190
2786999183,13cyclictest17207-21/usr/sbin/munin20:12:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional