You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 11:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Sat Dec 20, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71660rcu_preempt0-21swapper/222:10:222
71660rcu_preempt0-21swapper/222:10:222
71620rcu_preempt0-21swapper/221:18:272
71620rcu_preempt0-21swapper/221:18:272
71620rcu_preempt0-21swapper/221:18:272
71560rcu_preempt0-21swapper/121:25:531
71560rcu_preempt0-21swapper/121:25:531
892199532cyclictest2934-21copy20:45:200
892199532cyclictest2934-21copy20:45:200
892199528cyclictest4087-21ntp_states21:55:340
892199528cyclictest4087-21ntp_states21:55:340
892199523cyclictest8729-21df_inode23:00:280
892199523cyclictest8729-21df_inode23:00:280
892199523cyclictest8729-21df_inode23:00:280
892199513cyclictest17614-21diskstats19:40:260
892199513cyclictest17614-21diskstats19:40:260
892199513cyclictest17614-21diskstats19:40:260
892199502cyclictest27094-21ssh21:40:090
892199502cyclictest27094-21ssh21:40:090
892199502cyclictest11247-21ssh21:11:200
892199502cyclictest11247-21ssh21:11:200
892199502cyclictest11247-21ssh21:11:200
892199501cyclictest7198-21apt-get21:00:230
892199501cyclictest7198-21apt-get21:00:230
892199501cyclictest27835-21ssh23:33:460
892199501cyclictest27835-21ssh23:33:460
892199501cyclictest27835-21ssh23:33:460
892199501cyclictest24848-21apt-get00:25:220
892199501cyclictest24848-21apt-get00:25:220
892199501cyclictest17077-21/usr/sbin/munin23:15:380
892199501cyclictest17077-21/usr/sbin/munin23:15:380
892199501cyclictest17077-21/usr/sbin/munin23:15:380
892199501cyclictest11835-21/usr/sbin/munin19:20:210
892199501cyclictest11835-21/usr/sbin/munin19:20:210
8921995015cyclictest13222-21apt-get19:25:210
8921995015cyclictest13222-21apt-get19:25:210
71500rcu_preempt0-21swapper/022:41:360
71500rcu_preempt0-21swapper/022:41:360
71500rcu_preempt0-21swapper/022:41:360
892199494cyclictest0-21swapper/021:30:400
892199494cyclictest0-21swapper/021:30:400
892199494cyclictest0-21swapper/000:05:340
892199494cyclictest0-21swapper/000:05:340
892199493cyclictest26007-21ssh22:34:250
892199493cyclictest26007-21ssh22:34:250
892199493cyclictest0-21swapper/023:56:050
892199493cyclictest0-21swapper/023:56:050
892199493cyclictest0-21swapper/023:39:420
892199493cyclictest0-21swapper/023:39:420
892199493cyclictest0-21swapper/022:25:240
892199493cyclictest0-21swapper/022:25:240
892199492cyclictest9528-21diskstats22:05:280
892199492cyclictest9528-21diskstats22:05:280
892199492cyclictest9528-21diskstats22:05:280
892199492cyclictest30580-21apt-get00:35:210
892199492cyclictest30580-21apt-get00:35:210
892199492cyclictest30580-21apt-get00:35:210
892199492cyclictest27543-21df_inode21:40:240
892199492cyclictest27543-21df_inode21:40:240
892199492cyclictest10437-21/usr/sbin/munin19:15:240
892199492cyclictest10437-21/usr/sbin/munin19:15:240
892199492cyclictest10437-21/usr/sbin/munin19:15:240
892199491cyclictest4352-21ssh23:49:350
892199491cyclictest4352-21ssh23:49:350
892199491cyclictest32573-21/usr/sbin/munin22:45:300
892199491cyclictest32573-21/usr/sbin/munin22:45:300
892199491cyclictest32573-21/usr/sbin/munin22:45:300
892199491cyclictest2894-21latency_hist20:45:100
892199491cyclictest2894-21latency_hist20:45:100
8921994914cyclictest0-21swapper/023:21:360
8921994914cyclictest0-21swapper/023:21:360
892199484cyclictest0-21swapper/023:50:240
892199484cyclictest0-21swapper/023:50:240
892199484cyclictest0-21swapper/020:20:380
892199484cyclictest0-21swapper/020:20:380
892199484cyclictest0-21swapper/020:20:380
892199483cyclictest0-21swapper/022:10:240
892199483cyclictest0-21swapper/022:10:240
892199483cyclictest0-21swapper/000:01:260
892199483cyclictest0-21swapper/000:01:260
892199482cyclictest31692-21diskstats23:40:280
892199482cyclictest31692-21diskstats23:40:280
892199482cyclictest31692-21diskstats23:40:280
892199482cyclictest29180-21munin-run22:40:100
892199482cyclictest29180-21munin-run22:40:100
892199482cyclictest22043-21ntp_states19:55:360
892199482cyclictest22043-21ntp_states19:55:360
892199482cyclictest0-21swapper/022:51:220
892199482cyclictest0-21swapper/022:51:220
892199481cyclictest5588-21apt-get22:55:240
892199481cyclictest5588-21apt-get22:55:240
892199481cyclictest17864-21apt-get22:20:180
892199481cyclictest17864-21apt-get22:20:180
892199481cyclictest12929-21/usr/sbin/munin21:15:370
892199481cyclictest12929-21/usr/sbin/munin21:15:370
892199481cyclictest12929-21/usr/sbin/munin21:15:370
8921994819cyclictest31110-21users21:45:390
8921994819cyclictest31110-21users21:45:390
892299473cyclictest23088-21diskstats23:25:281
892299473cyclictest23088-21diskstats23:25:281
8922994715cyclictest11783-21memory23:05:321
8922994715cyclictest11783-21memory23:05:321
892199473cyclictest1472-21munin-run20:40:100
892199473cyclictest1472-21munin-run20:40:100
892199473cyclictest1472-21munin-run20:40:100
892199473cyclictest0-21swapper/023:13:050
892199473cyclictest0-21swapper/023:13:050
892199473cyclictest0-21swapper/023:08:150
892199473cyclictest0-21swapper/023:08:150
892199473cyclictest0-21swapper/021:00:100
892199473cyclictest0-21swapper/021:00:100
892199473cyclictest0-21swapper/021:00:100
892199473cyclictest0-21swapper/020:50:360
892199473cyclictest0-21swapper/020:50:360
892199473cyclictest0-21swapper/020:50:360
892199473cyclictest0-21swapper/020:15:320
892199473cyclictest0-21swapper/020:15:320
892199472cyclictest6385-21/usr/sbin/munin22:00:370
892199472cyclictest6385-21/usr/sbin/munin22:00:370
892199472cyclictest25938-21diskstats20:10:260
892199472cyclictest25938-21diskstats20:10:260
892199472cyclictest16229-21apt-get00:10:220
892199472cyclictest16229-21apt-get00:10:220
892199472cyclictest0-21swapper/023:25:240
892199472cyclictest0-21swapper/023:25:240
892199472cyclictest0-21swapper/000:30:330
892199472cyclictest0-21swapper/000:30:330
892199472cyclictest0-21swapper/000:30:330
892199471cyclictest569-21ssh21:50:200
892199471cyclictest569-21ssh21:50:200
892199471cyclictest569-21ssh21:50:200
8921994715cyclictest16171-21irqstats21:20:290
8921994715cyclictest16171-21irqstats21:20:290
8921994712cyclictest9056-21apt-get19:10:190
8921994712cyclictest9056-21apt-get19:10:190
892199463cyclictest17237-21munin-run19:40:110
892199463cyclictest17237-21munin-run19:40:110
892199463cyclictest17237-21munin-run19:40:110
892199463cyclictest0-21swapper/019:30:230
892199463cyclictest0-21swapper/019:30:230
892199463cyclictest0-21swapper/000:15:340
892199463cyclictest0-21swapper/000:15:340
892199463cyclictest0-21swapper/000:15:340
892199462cyclictest23103-21grep20:00:240
892199462cyclictest23103-21grep20:00:240
892199462cyclictest22443-21meminfo00:20:330
892199462cyclictest22443-21meminfo00:20:330
892199462cyclictest0-21swapper/021:25:240
892199462cyclictest0-21swapper/021:25:240
892299454cyclictest0-21swapper/100:20:411
892299454cyclictest0-21swapper/100:20:411
892199453cyclictest0-21swapper/021:06:210
892199453cyclictest0-21swapper/021:06:210
892199452cyclictest15245-21df_inode22:15:260
892199452cyclictest15245-21df_inode22:15:260
892199451cyclictest31245-21apt-get20:30:210
892199451cyclictest31245-21apt-get20:30:210
892199451cyclictest31245-21apt-get20:30:210
892299443cyclictest0-21swapper/123:58:331
892299443cyclictest0-21swapper/123:58:331
892299443cyclictest0-21swapper/122:55:311
892299443cyclictest0-21swapper/122:55:311
892299443cyclictest0-21swapper/121:42:421
892299443cyclictest0-21swapper/121:42:421
892299442cyclictest16247-1kworker/1:2H22:25:381
892299442cyclictest16247-1kworker/1:2H22:25:381
892199443cyclictest20535-21meminfo19:50:300
892199443cyclictest20535-21meminfo19:50:300
71440rcu_preempt0-21swapper/223:56:452
71440rcu_preempt0-21swapper/223:56:452
46050440irq/122-QManpo0-210
46050440irq/122-QManpo0-210
46050440irq/122-QManpo0-210
892299434cyclictest0-21swapper/123:30:351
892299434cyclictest0-21swapper/123:30:351
892299434cyclictest0-21swapper/123:30:351
892299433cyclictest0-21swapper/123:35:241
892299433cyclictest0-21swapper/123:35:241
892299433cyclictest0-21swapper/122:51:321
892299433cyclictest0-21swapper/122:51:321
892299433cyclictest0-21swapper/121:00:101
892299433cyclictest0-21swapper/121:00:101
892299433cyclictest0-21swapper/121:00:101
892299433cyclictest0-21swapper/120:35:241
892299433cyclictest0-21swapper/120:35:241
892299433cyclictest0-21swapper/120:35:241
892299433cyclictest0-21swapper/100:00:341
892299433cyclictest0-21swapper/100:00:341
892199432cyclictest24321-21/usr/sbin/munin20:05:330
892199432cyclictest24321-21/usr/sbin/munin20:05:330
892199431cyclictest18759-21apt-get19:45:220
892199431cyclictest18759-21apt-get19:45:220
892199431cyclictest18759-21apt-get19:45:220
892299423cyclictest0-21swapper/123:11:521
892299423cyclictest0-21swapper/123:11:521
892299423cyclictest0-21swapper/122:05:261
892299423cyclictest0-21swapper/122:05:261
892299423cyclictest0-21swapper/122:05:261
892299423cyclictest0-21swapper/121:30:381
892299423cyclictest0-21swapper/121:30:381
892299423cyclictest0-21swapper/119:41:171
892299423cyclictest0-21swapper/119:41:171
892299423cyclictest0-21swapper/119:41:171
892299423cyclictest0-21swapper/119:35:371
892299423cyclictest0-21swapper/119:35:371
892299423cyclictest0-21swapper/119:35:371
892299423cyclictest0-21swapper/119:30:301
892299423cyclictest0-21swapper/119:30:301
892299423cyclictest0-21swapper/119:10:291
892299423cyclictest0-21swapper/119:10:291
892299423cyclictest0-21swapper/100:35:341
892299423cyclictest0-21swapper/100:35:341
892299423cyclictest0-21swapper/100:35:341
892299423cyclictest0-21swapper/100:10:261
892299423cyclictest0-21swapper/100:10:261
892299422cyclictest3965-21ssh21:55:301
892299422cyclictest3965-21ssh21:55:301
892299422cyclictest27981-21df_inode00:30:281
892299422cyclictest27981-21df_inode00:30:281
892299422cyclictest27981-21df_inode00:30:281
892299422cyclictest15568-21ntp_states22:15:361
892299422cyclictest15568-21ntp_states22:15:361
892299422cyclictest0-21swapper/120:05:251
892299422cyclictest0-21swapper/120:05:251
892299421cyclictest8931-21/usr/sbin/munin23:00:341
892299421cyclictest8931-21/usr/sbin/munin23:00:341
892299421cyclictest8931-21/usr/sbin/munin23:00:341
892299421cyclictest1959-21runrttasks22:45:351
892299421cyclictest1959-21runrttasks22:45:351
892299421cyclictest1959-21runrttasks22:45:351
892199423cyclictest29718-21latency_hist20:25:150
892199423cyclictest29718-21latency_hist20:25:150
892199423cyclictest29718-21latency_hist20:25:150
892299414cyclictest0-21swapper/122:30:171
892299414cyclictest0-21swapper/122:30:171
892299413cyclictest0-21swapper/123:15:371
892299413cyclictest0-21swapper/123:15:371
892299413cyclictest0-21swapper/123:15:371
892299413cyclictest0-21swapper/122:38:401
892299413cyclictest0-21swapper/122:38:401
892299413cyclictest0-21swapper/121:50:181
892299413cyclictest0-21swapper/121:50:181
892299413cyclictest0-21swapper/121:50:181
892299413cyclictest0-21swapper/121:47:511
892299413cyclictest0-21swapper/121:47:511
892299413cyclictest0-21swapper/121:17:191
892299413cyclictest0-21swapper/121:17:191
892299413cyclictest0-21swapper/121:17:191
892299413cyclictest0-21swapper/100:30:091
892299413cyclictest0-21swapper/100:30:091
892299412cyclictest9820-21cron21:10:091
892299412cyclictest9820-21cron21:10:091
892299412cyclictest31684-21df_inode23:40:271
892299412cyclictest31684-21df_inode23:40:271
892299412cyclictest31684-21df_inode23:40:271
892299412cyclictest24615-21df21:35:251
892299412cyclictest24615-21df21:35:251
892299412cyclictest2169-21diskstats23:45:271
892299412cyclictest2169-21diskstats23:45:271
892299412cyclictest1858-21df_inode20:40:231
892299412cyclictest1858-21df_inode20:40:231
892299412cyclictest16279-21meminfo21:20:311
892299412cyclictest16279-21meminfo21:20:311
892299412cyclictest0-21swapper/121:05:111
892299412cyclictest0-21swapper/121:05:111
892299411cyclictest13533-21cpu00:05:241
892299411cyclictest13533-21cpu00:05:241
71410rcu_preempt19787-21apt-get23:20:411
71410rcu_preempt19787-21apt-get23:20:411
71410rcu_preempt0-21swapper/323:10:143
71410rcu_preempt0-21swapper/323:10:143
892299403cyclictest0-21swapper/120:49:001
892299403cyclictest0-21swapper/120:49:001
892299403cyclictest0-21swapper/120:05:101
892299403cyclictest0-21swapper/120:05:101
892299403cyclictest0-21swapper/119:25:321
892299403cyclictest0-21swapper/119:25:321
892299402cyclictest19682-21ntp_states00:15:351
892299402cyclictest19682-21ntp_states00:15:351
892299402cyclictest19682-21ntp_states00:15:351
892299402cyclictest0-21swapper/122:22:131
892299402cyclictest0-21swapper/122:22:131
892299401cyclictest9830-21diskmemload23:52:351
892299401cyclictest9830-21diskmemload23:52:351
892299401cyclictest0-21swapper/122:00:221
892299401cyclictest0-21swapper/122:00:221
892299401cyclictest0-21swapper/119:20:331
892299401cyclictest0-21swapper/119:20:331
892299391cyclictest0-21swapper/121:10:241
892299391cyclictest0-21swapper/121:10:241
892299391cyclictest0-21swapper/121:10:241
8922993915cyclictest29367-21apt-get22:40:231
8922993915cyclictest29367-21apt-get22:40:231
8922993915cyclictest29367-21apt-get22:40:231
71390rcu_preempt29966-21crond21:45:093
71390rcu_preempt29966-21crond21:45:093
71390rcu_preempt0-21swapper/223:25:352
71390rcu_preempt0-21swapper/223:25:352
71390rcu_preempt0-21swapper/222:26:312
71390rcu_preempt0-21swapper/222:26:312
892299383cyclictest0-21swapper/122:12:131
892299383cyclictest0-21swapper/122:12:131
892299382cyclictest0-21swapper/120:25:251
892299382cyclictest0-21swapper/120:25:251
892299382cyclictest0-21swapper/120:25:251
892299382cyclictest0-21swapper/119:55:321
892299382cyclictest0-21swapper/119:55:321
8922993815cyclictest28484-21apt-get20:20:221
8922993815cyclictest28484-21apt-get20:20:221
8922993815cyclictest28484-21apt-get20:20:221
71380rcu_preempt0-21swapper/223:15:532
71380rcu_preempt0-21swapper/223:15:532
71380rcu_preempt0-21swapper/223:15:532
71380rcu_preempt0-21swapper/222:35:262
71380rcu_preempt0-21swapper/222:35:262
71380rcu_preempt0-21swapper/222:07:432
71380rcu_preempt0-21swapper/222:07:432
71380rcu_preempt0-21swapper/222:07:432
71380rcu_preempt0-21swapper/200:40:172
71380rcu_preempt0-21swapper/200:40:172
892299372cyclictest4657-21diskstats20:50:251
892299372cyclictest4657-21diskstats20:50:251
892299372cyclictest4657-21diskstats20:50:251
892299372cyclictest26614-1kworker/1:1H20:15:351
892299372cyclictest26614-1kworker/1:1H20:15:351
892299372cyclictest25938-21diskstats20:10:261
892299372cyclictest25938-21diskstats20:10:261
892299372cyclictest1959-21runrttasks19:50:571
892299372cyclictest1959-21runrttasks19:50:571
892299372cyclictest19158-21/usr/sbin/munin19:45:311
892299372cyclictest19158-21/usr/sbin/munin19:45:311
892299372cyclictest19158-21/usr/sbin/munin19:45:311
892299372cyclictest11704-21munin-run19:20:091
892299372cyclictest11704-21munin-run19:20:091
892299372cyclictest11704-21munin-run19:20:091
71370rcu_preempt0-21swapper/320:45:203
71370rcu_preempt0-21swapper/320:45:203
71370rcu_preempt0-21swapper/222:25:112
71370rcu_preempt0-21swapper/222:25:112
71370rcu_preempt0-21swapper/219:10:082
71370rcu_preempt0-21swapper/219:10:082
71370rcu_preempt0-21swapper/219:10:082
46250370irq/120-QManpo0-2110:48:551
46250370irq/120-QManpo0-2110:48:551
46250370irq/120-QManpo0-2110:48:551
2899370migration/38657-21taskset19:07:073
2899370migration/38657-21taskset19:07:073
2899370migration/38657-21taskset19:07:073
71360rcu_preempt3493-21seq23:47:192
71360rcu_preempt3493-21seq23:47:192
71360rcu_preempt0-21swapper/323:49:573
71360rcu_preempt0-21swapper/323:49:573
71360rcu_preempt0-21swapper/223:52:382
71360rcu_preempt0-21swapper/223:52:382
892299351cyclictest1959-21runrttasks20:33:521
892299351cyclictest1959-21runrttasks20:33:521
892299351cyclictest1959-21runrttasks20:33:521
71350rcu_preempt8806-1kworker/2:1H00:26:292
71350rcu_preempt8806-1kworker/2:1H00:26:292
71350rcu_preempt28116-21ssh23:34:313
71350rcu_preempt28116-21ssh23:34:313
71350rcu_preempt28116-21ssh23:34:313
71350rcu_preempt0-21swapper/322:06:033
71350rcu_preempt0-21swapper/322:06:033
71350rcu_preempt0-21swapper/322:06:033
71350rcu_preempt0-21swapper/222:43:262
71350rcu_preempt0-21swapper/222:43:262
71350rcu_preempt0-21swapper/222:43:262
71350rcu_preempt0-21swapper/222:30:272
71350rcu_preempt0-21swapper/222:30:272
71350rcu_preempt0-21swapper/222:17:132
71350rcu_preempt0-21swapper/222:17:132
71350rcu_preempt0-21swapper/221:36:582
71350rcu_preempt0-21swapper/221:36:582
71350rcu_preempt0-21swapper/220:55:132
71350rcu_preempt0-21swapper/220:55:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional