You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 04:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1.osadl.org (updated Mon Dec 15, 2025 01:38:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3076821470,1sleep3321rcuc/300:31:543
3076821470,1sleep3321rcuc/300:31:543
194482940,2chrt19449-21/usr/sbin/munin19:36:500
243512900,4sleep20-21swapper/219:51:422
270912740,3sleep30-21swapper/319:56:543
324922680,2sleep232627-21threads00:36:522
216392660,3sleep30-21swapper/321:12:003
67942600,3chrt0-21swapper/222:00:002
67942600,3chrt0-21swapper/222:00:002
250372600,3chrt0-21swapper/300:16:513
156922570,4chrt0-21swapper/220:56:442
156922570,4chrt0-21swapper/220:56:442
278862550,3sleep30-21swapper/321:26:543
278862550,3sleep30-21swapper/321:26:543
326292530,7sleep333-21ksoftirqd/300:36:523
66972520,4sleep30-21swapper/323:26:533
84632510,11sleep333-21ksoftirqd/320:36:443
202662510,4sleep20-21swapper/222:36:452
154242510,3chrt0-21swapper/020:55:010
93502480,2sleep29187-21ls19:10:042
186102460,3chrt0-21swapper/200:00:032
13752460,3sleep20-21swapper/221:45:022
13752460,3sleep20-21swapper/221:45:022
9152440,3sleep00-21swapper/021:41:540
9152440,3sleep00-21swapper/021:41:540
122132440,3sleep00-21swapper/019:16:520
122132440,3sleep00-21swapper/019:16:520
179922430,2sleep30-21swapper/323:56:543
83952400,3sleep30-21swapper/323:31:473
83952400,3sleep30-21swapper/323:31:473
291582380,2chrt0-21swapper/021:31:460
233822370,3sleep30-21swapper/319:46:543
233822370,3sleep30-21swapper/319:46:543
198552350,3sleep30-21swapper/319:36:533
235612320,5sleep023563-21grep19:46:540
235612320,5sleep023563-21grep19:46:540
261552290,1sleep126199-21cat19:56:451
156272280,4sleep319821-21kworker/3:019:26:483
95812260,3sleep30-21swapper/322:06:483
94102265,14sleep10-21swapper/119:10:191
9468992315,6cyclictest17016-21df19:31:442
9468992315,6cyclictest17016-21df19:31:442
93962234,14sleep30-21swapper/319:10:093
212202230,3sleep30-21swapper/322:36:543
9469992216,4cyclictest321rcuc/322:50:013
9469992216,4cyclictest321rcuc/322:50:013
9469992216,4cyclictest321rcuc/320:32:513
9469992216,4cyclictest321rcuc/320:23:513
9469992216,4cyclictest321rcuc/320:23:513
9468992213,7cyclictest31936-21grep20:11:452
946799221,19cyclictest31673-21find00:36:431
946799221,18cyclictest30394-21find21:36:441
946799221,18cyclictest30394-21find21:36:441
946699226,3cyclictest169842grep23:56:440
946699225,8cyclictest12-21ksoftirqd/020:42:110
946699225,8cyclictest12-21ksoftirqd/020:42:110
9466992213,7cyclictest12816-21fschecks_count22:16:450
272352220,3sleep30-21swapper/300:21:543
272352220,3sleep30-21swapper/300:21:543
268712220,3sleep00-21swapper/000:21:510
268712220,3sleep00-21swapper/000:21:510
172892220,12sleep333-21ksoftirqd/319:31:463
172892220,12sleep333-21ksoftirqd/319:31:463
9469992115,4cyclictest321rcuc/321:52:033
946899219,9cyclictest4008-21grep20:21:542
946899219,9cyclictest4008-21grep20:21:542
946899212,17cyclictest22605-21grep00:11:452
946899212,17cyclictest22605-21grep00:11:452
9468992113,6cyclictest22953-21sed22:41:532
9468992113,6cyclictest22953-21sed22:41:532
946899211,18cyclictest22168-21ls21:12:062
946799217,11cyclictest25163-21cron22:50:001
946799217,11cyclictest25163-21cron22:50:001
9467992112,7cyclictest24615-21idleruntime19:51:441
946799211,16cyclictest3633-21grep21:51:441
946799211,16cyclictest15639-21ls19:26:481
9466992115,5cyclictest2258-21/usr/sbin/munin23:16:520
9466992115,5cyclictest2258-21/usr/sbin/munin23:16:520
9466992114,6cyclictest535-21snmpd00:13:020
9466992114,6cyclictest535-21snmpd00:13:020
9466992114,5cyclictest2018-21idleruntime21:46:460
946699211,18cyclictest16607-21ls20:56:530
946699211,18cyclictest16607-21ls20:56:530
946699211,11cyclictest29757-21missed_timers23:01:480
946699211,11cyclictest29757-21missed_timers23:01:480
9469992015,4cyclictest321rcuc/323:48:353
9469992015,3cyclictest321rcuc/323:36:383
946899202,9cyclictest11673-21gltestperf19:16:462
946899202,9cyclictest11673-21gltestperf19:16:462
9468992013,5cyclictest28339-21sed22:56:532
9468992013,5cyclictest28339-21sed22:56:532
9468992013,5cyclictest17513-21unixbench_singl22:26:542
9468992013,5cyclictest17513-21unixbench_singl22:26:542
946899201,17cyclictest21715-21ls00:06:542
946899201,15cyclictest20601-21find19:41:482
946899201,11cyclictest697-21runrttasks22:24:242
9467992013,5cyclictest1631-21netstat20:16:481
946799201,17cyclictest10684-21ls23:36:531
9466992012,6cyclictest28931-21timerandwakeup20:01:530
9466992012,6cyclictest28931-21timerandwakeup20:01:530
946699201,13cyclictest6573-21ls20:31:430
93982205,8sleep00-21swapper/019:10:100
269442200,3sleep20-21swapper/219:56:532
216982200,9sleep333-21ksoftirqd/319:41:593
107682201,2sleep10-21swapper/122:11:051
107682201,2sleep10-21swapper/122:11:051
9469991914,3cyclictest321rcuc/300:25:043
9469991914,3cyclictest321rcuc/300:05:273
9469991913,4cyclictest321rcuc/323:43:413
9469991913,4cyclictest321rcuc/323:12:513
9469991913,4cyclictest321rcuc/321:10:003
9469991913,4cyclictest321rcuc/320:40:263
9469991913,4cyclictest321rcuc/320:40:263
946999191,12cyclictest0-21swapper/322:35:033
946999191,12cyclictest0-21swapper/322:35:033
946899198,8cyclictest22759-21gltestperf19:46:462
946899198,8cyclictest22759-21gltestperf19:46:462
946899196,11cyclictest5748-21timerwakeupswit20:26:532
946899196,11cyclictest5748-21timerwakeupswit20:26:532
946899194,13cyclictest19293-21wc19:36:462
9468991911,6cyclictest136-21systemd-journal20:55:002
946899191,10cyclictest10499-21taskset22:10:002
9468991910,7cyclictest12763-21pluginstate20:46:502
9468991910,6cyclictest7986-21cron20:35:002
946899190,12cyclictest18272-21ls22:31:442
946899190,12cyclictest18272-21ls22:31:442
946799199,8cyclictest22698-21perl19:46:451
946799199,8cyclictest22698-21perl19:46:451
946799191,9cyclictest24525-21cron21:20:001
946799191,9cyclictest24525-21cron21:20:001
946799190,10cyclictest25098-21grep21:21:461
946799190,10cyclictest25098-21grep21:21:461
946699196,10cyclictest26198-21entropy19:56:450
946699196,10cyclictest12785-21grep20:46:500
946699192,14cyclictest30453-21ntp_states20:06:500
946699192,14cyclictest30453-21ntp_states20:06:500
946699191,5cyclictest0-21swapper/019:31:460
946699191,5cyclictest0-21swapper/019:31:460
946699191,16cyclictest11759-21ls22:11:520
946699191,16cyclictest11759-21ls22:11:520
323822191,3sleep10-21swapper/123:08:271
278532190,3sleep30-21swapper/322:56:473
278532190,3sleep30-21swapper/322:56:473
167992190,3sleep121-21ksoftirqd/123:55:031
9469991812,4cyclictest321rcuc/323:08:543
9469991812,4cyclictest321rcuc/321:43:593
9469991812,4cyclictest321rcuc/321:43:593
9469991812,4cyclictest321rcuc/300:11:573
9469991812,4cyclictest321rcuc/300:11:573
946999181,13cyclictest0-21swapper/322:41:533
946999181,13cyclictest0-21swapper/322:41:533
946999181,13cyclictest0-21swapper/319:16:543
946999181,13cyclictest0-21swapper/319:16:543
946999181,12cyclictest0-21swapper/321:21:533
946999181,12cyclictest0-21swapper/321:21:533
946999181,12cyclictest0-21swapper/319:51:413
946999181,12cyclictest0-21swapper/300:01:433
946899188,8cyclictest24408-21df00:16:442
946899186,10cyclictest4369-21fschecks_time23:21:452
946899186,10cyclictest4369-21fschecks_time23:21:452
946899186,10cyclictest28468-21kernelversion00:26:472
946899185,9cyclictest32666-21latency_hist23:10:022
946899183,13cyclictest26999-21idleruntime-cro22:55:002
946899182,13cyclictest14507-21grep23:46:542
946899182,12cyclictest10477-21uniq20:42:032
946899182,12cyclictest10477-21uniq20:42:032
9468991812,4cyclictest0-21swapper/220:06:442
9468991812,4cyclictest0-21swapper/220:06:442
9468991811,5cyclictest30810-21awk21:36:472
9468991811,5cyclictest30810-21awk21:36:472
946899181,14cyclictest2500-21ls20:20:002
946899181,13cyclictest27757-21latency_hist00:25:012
946899181,13cyclictest27757-21latency_hist00:25:012
9468991810,6cyclictest11455-21netstat22:11:482
9468991810,6cyclictest11455-21netstat22:11:482
9468991810,6cyclictest0-21swapper/222:16:522
946799187,9cyclictest15686-21grep22:21:541
946799184,12cyclictest28975-21awk00:26:531
946799183,13cyclictest30312-21sed23:01:541
946799183,13cyclictest30312-21sed23:01:541
946799181,7cyclictest1965-21gltestperf21:46:461
9467991811,5cyclictest28120-21fschecks_count20:01:451
9467991811,5cyclictest28120-21fschecks_count20:01:451
946799181,13cyclictest32520-21grep21:41:461
946799181,13cyclictest32520-21grep21:41:461
946799181,13cyclictest14975-21grep20:51:571
946799181,12cyclictest8342-21find20:36:421
946799180,16cyclictest17548-21ls23:56:491
946799180,12cyclictest13789-21ls23:46:471
946699189,7cyclictest31865-21cron21:40:000
946699189,7cyclictest31865-21cron21:40:000
946699187,9cyclictest38950irq/56-eth022:29:160
946699187,9cyclictest38950irq/56-eth022:29:160
946699186,10cyclictest4605-21tail21:51:530
946699181,9cyclictest6101-21fschecks_count23:26:460
946699181,9cyclictest20647-21/usr/sbin/munin00:06:460
946699181,2cyclictest131rcu_preempt19:26:520
946699181,15cyclictest16671-21latency_hist23:55:010
9466991811,5cyclictest0-21swapper/021:25:000
9466991811,5cyclictest0-21swapper/021:25:000
9466991811,5cyclictest0-21swapper/020:16:450
946699181,14cyclictest32484-21grep00:36:510
946699181,14cyclictest23978-21wc21:16:540
946699181,14cyclictest23978-21wc21:16:540
946699181,12cyclictest9268-21awk23:35:000
946699181,12cyclictest9268-21awk23:35:000
9466991810,6cyclictest31781-21wc23:06:510
9466991810,6cyclictest3175-21grep20:21:460
9466991810,6cyclictest3175-21grep20:21:460
54112181,3sleep10-21swapper/123:22:421
54112181,3sleep10-21swapper/123:22:421
175412181,3sleep10-21swapper/121:01:421
175412181,3sleep10-21swapper/121:01:421
169912181,3sleep10-21swapper/120:57:441
169912181,3sleep10-21swapper/120:57:441
9469991712,4cyclictest321rcuc/321:58:183
9469991712,4cyclictest321rcuc/321:58:183
9469991712,4cyclictest0-21swapper/320:50:033
9469991712,3cyclictest0-21swapper/322:21:483
9469991711,4cyclictest321rcuc/322:50:533
9469991711,4cyclictest321rcuc/322:27:273
9469991711,4cyclictest321rcuc/322:27:273
9469991711,4cyclictest321rcuc/322:00:103
9469991711,4cyclictest321rcuc/321:15:063
9469991711,4cyclictest321rcuc/321:15:063
946999171,12cyclictest0-21swapper/321:36:483
946999171,12cyclictest0-21swapper/321:36:483
946999171,11cyclictest0-21swapper/320:06:523
946999171,11cyclictest0-21swapper/320:06:523
9469991710,5cyclictest321rcuc/323:20:353
9469991710,5cyclictest321rcuc/323:20:353
9469991710,5cyclictest321rcuc/322:10:193
9469991710,5cyclictest321rcuc/322:10:193
946899179,5cyclictest3781-21sendmail23:20:002
946899179,5cyclictest3781-21sendmail23:20:002
946899178,7cyclictest11675-21sort23:41:482
946899175,10cyclictest19954-21grep00:01:532
946899173,12cyclictest20193-21sendmail_mailqu21:06:522
946899172,13cyclictest28241-21grep20:01:462
946899172,13cyclictest28241-21grep20:01:462
946899171,9cyclictest10102-21wc23:36:472
9468991711,5cyclictest24896-21/usr/sbin/munin21:21:482
9468991711,5cyclictest24896-21/usr/sbin/munin21:21:482
9468991711,4cyclictest7963-21find22:01:512
946899171,14cyclictest24742-21timerwakeupswit22:46:532
946899171,14cyclictest24742-21timerwakeupswit22:46:532
946899171,13cyclictest8954-21needreboot20:36:472
946899171,13cyclictest28348-21grep21:30:032
946899171,13cyclictest28348-21grep21:30:032
946899171,13cyclictest1833-21grep21:46:452
946899171,13cyclictest156262memory19:26:482
9468991710,5cyclictest0-21swapper/219:21:492
946899170,13cyclictest16191-21timerwakeupswit23:51:552
946799178,7cyclictest19423-21ntpq19:36:481
946799176,9cyclictest9582-21sed22:06:481
946799175,10cyclictest22703-21fschecks_time00:11:451
946799175,10cyclictest22703-21fschecks_time00:11:451
946799175,10cyclictest18913-21ls00:01:431
946799175,10cyclictest12091-21gzip23:41:511
946799173,11cyclictest7431-21grep22:01:451
946799171,14cyclictest5313-21/usr/sbin/munin21:56:441
946799171,14cyclictest5313-21/usr/sbin/munin21:56:441
946799171,14cyclictest25446-21tail00:16:541
946799171,14cyclictest21962-21df22:41:431
946799171,14cyclictest21962-21df22:41:431
946799171,14cyclictest1973-21latency_hist23:15:001
9467991711,4cyclictest0-21swapper/123:16:431
9467991711,4cyclictest0-21swapper/123:16:431
946799171,13cyclictest8020-21grep23:31:431
946799171,13cyclictest8020-21grep23:31:431
946799171,13cyclictest18408-21grep22:31:471
946799171,13cyclictest18408-21grep22:31:471
946799171,13cyclictest13532-21grep19:21:451
946799171,12cyclictest22226-21grep00:10:021
946799171,11cyclictest21638-21ls19:41:591
9467991710,5cyclictest13744-21unixbench-2d22:16:541
9467991710,5cyclictest0-21swapper/122:26:501
9467991710,5cyclictest0-21swapper/122:26:501
946799170,15cyclictest12230-21grep20:46:441
946799170,13cyclictest30866-21timerwakeupswit00:31:551
946799170,13cyclictest30866-21timerwakeupswit00:31:551
946699179,6cyclictest14874-21grep22:21:460
946699179,6cyclictest11713-21fschecks_time23:41:480
946699179,6cyclictest10231-21head23:36:480
946699178,7cyclictest28139-21cut00:26:450
946699178,7cyclictest22173-21grep19:45:020
946699177,8cyclictest38950irq/56-eth022:59:150
946699177,8cyclictest38950irq/56-eth022:59:150
946699176,9cyclictest38950irq/56-eth022:06:040
946699176,9cyclictest38850irq/55-eth022:36:490
946699176,9cyclictest38850irq/55-eth021:56:510
946699176,9cyclictest38850irq/55-eth021:56:510
946699175,10cyclictest38950irq/56-eth020:11:500
946699173,3cyclictest131rcu_preempt00:01:500
946699171,9cyclictest26176-21netstat22:51:510
9466991712,3cyclictest12-21ksoftirqd/021:26:520
9466991712,3cyclictest12-21ksoftirqd/021:26:520
946699171,14cyclictest4972-21grep20:26:450
946699171,14cyclictest4972-21grep20:26:450
946699171,14cyclictest25003-21ntp_states00:16:510
946699171,10cyclictest697-21runrttasks21:00:380
946699171,10cyclictest697-21runrttasks21:00:380
9466991710,5cyclictest20464-21/usr/sbin/munin21:06:530
946699170,14cyclictest24247-21acpi19:51:410
243032171,3sleep20-21swapper/221:17:142
243032171,3sleep20-21swapper/221:17:142
946999169,5cyclictest321rcuc/320:10:333
9469991612,3cyclictest321rcuc/320:04:103
9469991612,3cyclictest321rcuc/320:04:103
9469991611,4cyclictest321rcuc/323:16:283
9469991611,4cyclictest321rcuc/323:16:283
9469991611,4cyclictest0-21swapper/320:56:463
9469991611,4cyclictest0-21swapper/320:56:463
9469991611,3cyclictest321rcuc/321:46:283
9469991611,3cyclictest321rcuc/321:30:573
946999161,13cyclictest0-21swapper/320:16:423
9469991610,4cyclictest321rcuc/323:50:563
946899168,6cyclictest30087-21uniq00:31:462
946899168,6cyclictest30087-21uniq00:31:462
946899165,2cyclictest131rcu_preempt23:25:152
946899162,11cyclictest747-21gltestperf23:11:462
946899161,13cyclictest0-21swapper/221:00:402
946899161,13cyclictest0-21swapper/221:00:402
946899161,12cyclictest8525-21grep23:31:502
946899161,12cyclictest8525-21grep23:31:502
946899161,12cyclictest4681-21users21:51:542
946899161,12cyclictest29363-21grep23:01:452
946899161,12cyclictest29363-21grep23:01:452
946799169,5cyclictest27350-21sort22:56:431
946799169,5cyclictest27350-21sort22:56:431
946799169,5cyclictest26060-21sshd00:20:251
946799169,5cyclictest26060-21sshd00:20:251
946799166,8cyclictest5947-21/usr/sbin/munin23:26:461
946799163,11cyclictest5021-21grep20:26:451
946799163,11cyclictest5021-21grep20:26:451
946799162,12cyclictest26896-21fschecks_count21:26:451
946799162,12cyclictest26896-21fschecks_count21:26:451
946799162,12cyclictest12956-21cat19:20:011
946799162,12cyclictest12956-21cat19:20:011
946799162,12cyclictest10596-21head20:42:041
946799162,12cyclictest10596-21head20:42:041
9467991611,3cyclictest30574-21sendmail_mailqu20:06:511
9467991611,3cyclictest30574-21sendmail_mailqu20:06:511
946799161,12cyclictest32341-21ps20:11:511
946799161,12cyclictest28798-21cut21:31:431
946799161,12cyclictest22817-21latency_hist21:15:021
946799161,12cyclictest20349-21grep21:06:531
946799161,12cyclictest17115-21fschecks_time19:31:451
946799161,12cyclictest17115-21fschecks_time19:31:451
946799161,11cyclictest25831-21grep22:51:471
946799161,11cyclictest21481-21cron22:40:001
946699169,5cyclictest8657-21gltestperf20:36:450
946699168,6cyclictest22396-21/usr/sbin/munin22:41:470
946699168,6cyclictest22396-21/usr/sbin/munin22:41:470
946699168,6cyclictest21925-21/usr/sbin/munin21:12:030
946699168,6cyclictest13369-21sort23:46:440
946699167,7cyclictest18278-21df22:31:450
946699167,7cyclictest18278-21df22:31:450
946699161,7cyclictest8026-21cut22:01:520
946699161,7cyclictest29797-21chrt00:31:150
946699161,7cyclictest29797-21chrt00:31:150
946699161,4cyclictest0-21swapper/019:21:460
946699161,13cyclictest659-21grep23:11:460
946699161,13cyclictest4699-21cat23:21:480
946699161,13cyclictest4699-21cat23:21:480
946699161,12cyclictest23856-21fschecks_count22:46:440
946699161,12cyclictest23856-21fschecks_count22:46:440
284732161,2sleep20-21swapper/221:30:442
946999151,9cyclictest0-21swapper/322:20:003
9469991511,3cyclictest321rcuc/319:24:123
9469991510,4cyclictest321rcuc/321:03:293
9469991510,4cyclictest321rcuc/321:03:293
9469991510,4cyclictest321rcuc/320:51:313
946799154,9cyclictest3155-21grep20:21:461
946799154,9cyclictest3155-21grep20:21:461
946799151,11cyclictest7060-21grep20:31:481
946999149,4cyclictest321rcuc/323:01:263
946999149,4cyclictest321rcuc/323:01:263
946999149,4cyclictest321rcuc/320:26:233
946999149,4cyclictest321rcuc/320:26:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional