You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 12:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Tue May 12, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8025992719,4cyclictest1264-21diskmemload21:34:213
802599270,26cyclictest0-21swapper/322:05:033
802599270,23cyclictest0-21swapper/322:58:043
802599260,25cyclictest27412-21ssh23:52:443
802599260,25cyclictest1264-21diskmemload00:06:563
802599260,25cyclictest0-21swapper/323:21:333
802599260,22cyclictest1757-21ssh23:31:413
8020992621,2cyclictest0-21swapper/200:21:202
8011992623,2cyclictest0-21swapper/023:49:220
8025992523,2cyclictest0-21swapper/323:28:113
802599250,21cyclictest23879-21ssh22:26:493
802599250,1cyclictest0-21swapper/323:55:113
8020992522,0cyclictest1264-21diskmemload21:20:522
8016992524,1cyclictest0-21swapper/100:28:451
8011992523,1cyclictest0-21swapper/021:30:000
8011992521,3cyclictest677-21ssh00:26:570
801199250,24cyclictest23679-21ssh23:50:050
8025992423,1cyclictest1264-21diskmemload22:14:023
8025992422,2cyclictest0-21swapper/322:48:143
8025992421,2cyclictest17452-21ssh21:23:423
8025992420,4cyclictest0-21swapper/322:53:343
8025992420,3cyclictest1264-21diskmemload21:53:243
8025992420,3cyclictest0-21swapper/322:24:053
802599240,24cyclictest0-21swapper/300:22:563
802599240,23cyclictest0-21swapper/322:38:593
802599240,23cyclictest0-21swapper/300:30:173
802599240,1cyclictest1264-21diskmemload21:38:543
802599240,0cyclictest0-21swapper/323:02:503
802599240,0cyclictest0-21swapper/321:29:413
802599240,0cyclictest0-21swapper/321:19:173
8020992422,1cyclictest0-21swapper/222:05:022
8020992421,2cyclictest23588-21ssh23:21:572
8020992421,2cyclictest17115-21ssh23:16:442
8020992420,0cyclictest0-21swapper/223:57:532
802099240,24cyclictest0-21swapper/223:04:562
802099240,23cyclictest0-21swapper/222:57:162
802099240,23cyclictest0-21swapper/222:38:382
802099240,23cyclictest0-21swapper/221:11:232
802099240,22cyclictest313-21systemd-journal19:25:012
802099240,0cyclictest1264-21diskmemload00:08:012
802099240,0cyclictest0-21swapper/200:11:552
8016992422,1cyclictest0-21swapper/121:53:141
801699240,24cyclictest0-21swapper/123:48:431
801699240,24cyclictest0-21swapper/100:04:361
801699240,23cyclictest7895-21sh23:07:181
801699240,23cyclictest1264-21diskmemload22:09:451
801699240,23cyclictest0-21swapper/123:34:531
801699240,23cyclictest0-21swapper/122:19:371
801699240,23cyclictest0-21swapper/119:56:531
8011992424,0cyclictest62550irq/127-eno122:59:150
8011992421,2cyclictest2453-40mandb00:00:010
801199240,24cyclictest1264-21diskmemload23:07:480
801199240,24cyclictest0-21swapper/023:14:040
801199240,24cyclictest0-21swapper/023:14:040
801199240,23cyclictest62550irq/127-eno100:05:040
801199240,23cyclictest4826-21cron20:10:010
801199240,23cyclictest1264-21diskmemload22:21:040
801199240,23cyclictest0-21swapper/000:21:420
801199240,1cyclictest6739-21rm23:35:430
801199240,1cyclictest27407-21ssh22:01:080
801199240,0cyclictest0-21swapper/021:36:030
8025992323,0cyclictest0-21swapper/323:10:103
8025992323,0cyclictest0-21swapper/323:10:103
8025992323,0cyclictest0-21swapper/300:39:043
8025992323,0cyclictest0-21swapper/300:18:513
8025992322,1cyclictest1264-21diskmemload23:44:253
8025992320,3cyclictest0-21swapper/321:40:263
8025992320,2cyclictest3292-21ssh00:00:413
802599230,2cyclictest20371-21cron19:35:013
802599230,23cyclictest19444-21ssh00:14:503
802599230,23cyclictest1264-21diskmemload22:34:263
802599230,23cyclictest0-21swapper/323:35:143
802599230,22cyclictest32463-21munin-run20:00:003
802599230,22cyclictest20349-21ssh23:18:433
802599230,1cyclictest19351-21/usr/sbin/munin23:47:003
802599230,0cyclictest10993-21apt-get21:46:523
8020992323,0cyclictest0-21swapper/221:31:532
8020992321,1cyclictest10781-21apt-get19:16:532
8020992321,1cyclictest0-21swapper/222:04:512
802099231,21cyclictest31435-21ssh21:36:122
802099230,23cyclictest1264-21diskmemload00:36:582
802099230,23cyclictest0-21swapper/223:43:582
802099230,23cyclictest0-21swapper/223:32:582
802099230,23cyclictest0-21swapper/221:41:232
802099230,23cyclictest0-21swapper/200:27:512
802099230,22cyclictest606-21dbus-daemon21:55:012
802099230,22cyclictest1264-21diskmemload22:28:102
802099230,22cyclictest0-21swapper/223:35:552
802099230,22cyclictest0-21swapper/223:10:432
802099230,22cyclictest0-21swapper/223:10:432
802099230,0cyclictest0-21swapper/220:26:532
802099230,0cyclictest0-21swapper/200:34:452
8016992323,0cyclictest1264-21diskmemload21:35:321
8016992323,0cyclictest0-21swapper/122:28:011
8016992323,0cyclictest0-21swapper/121:55:191
8016992323,0cyclictest0-21swapper/121:46:401
8016992323,0cyclictest0-21swapper/121:43:591
8016992323,0cyclictest0-21swapper/121:12:411
8016992322,1cyclictest1264-21diskmemload21:21:291
8016992321,1cyclictest30240-21ssh23:56:141
8016992321,1cyclictest28914-21perf21:00:011
8016992321,1cyclictest0-21swapper/123:51:001
8016992321,1cyclictest0-21swapper/122:10:211
801699230,23cyclictest0-21swapper/122:54:071
801699230,23cyclictest0-21swapper/121:15:531
801699230,23cyclictest0-21swapper/100:20:441
801699230,22cyclictest23996-21ssh00:18:191
801699230,22cyclictest1264-21diskmemload22:35:521
801699230,22cyclictest11686-21apt-get23:40:021
801699230,1cyclictest19820-21latency_hist00:15:011
801699230,1cyclictest0-21swapper/123:38:511
801699230,1cyclictest0-21swapper/100:05:571
801699230,0cyclictest1264-21diskmemload21:25:221
801699230,0cyclictest0-21swapper/123:16:501
801699230,0cyclictest0-21swapper/122:57:321
8011992323,0cyclictest1264-21diskmemload23:40:260
8011992323,0cyclictest1264-21diskmemload22:09:350
8011992323,0cyclictest0-21swapper/023:30:340
8011992323,0cyclictest0-21swapper/022:41:010
8011992323,0cyclictest0-21swapper/021:50:330
8011992323,0cyclictest0-21swapper/000:10:430
8011992321,1cyclictest28391-21ssh22:30:110
8011992320,2cyclictest6897-21rm21:14:560
8011992320,2cyclictest0-21swapper/022:46:450
801199230,23cyclictest1264-21diskmemload21:16:360
801199230,23cyclictest0-21swapper/022:13:230
801199230,22cyclictest6036-21ssh00:02:060
801199230,22cyclictest26199-21apt-get21:31:550
801199230,22cyclictest23556-21ssh00:17:460
801199230,22cyclictest1264-21diskmemload23:25:300
801199230,22cyclictest1264-21diskmemload22:15:450
801199230,22cyclictest1264-21diskmemload21:41:240
801199230,22cyclictest0-21swapper/022:26:190
801199230,0cyclictest0-21swapper/000:31:350
8025992222,0cyclictest1264-21diskmemload22:15:303
8025992220,1cyclictest7243-21grep20:15:013
8025992219,2cyclictest7705-21ssh22:40:023
8025992219,2cyclictest2456-21munin-plugin-st20:05:013
802599220,22cyclictest21346-21ssh21:55:443
802599220,21cyclictest26946-21ssh22:00:243
802599220,21cyclictest0-21swapper/323:05:353
802599220,21cyclictest0-21swapper/319:26:523
802599220,21cyclictest0-21swapper/319:11:533
802599220,1cyclictest1776-21ssh21:10:193
802599220,1cyclictest15210-21perf19:25:013
802599220,1cyclictest10057-21apt-get20:21:543
8020992222,0cyclictest1264-21diskmemload23:50:252
8020992222,0cyclictest1264-21diskmemload22:32:542
8020992222,0cyclictest0-21swapper/222:18:092
8020992222,0cyclictest0-21swapper/221:15:292
8020992221,1cyclictest1264-21diskmemload00:00:132
8020992220,1cyclictest7787-21diskmemload22:40:092
8020992220,1cyclictest0-21swapper/222:10:092
8020992220,1cyclictest0-21swapper/221:45:282
8020992220,1cyclictest0-21swapper/200:15:482
802099221,21cyclictest22196-21diskmemload21:56:482
802099220,21cyclictest4605-21diskmemload23:05:142
802099220,21cyclictest0-21swapper/223:46:252
802099220,21cyclictest0-21swapper/223:25:352
802099220,21cyclictest0-21swapper/219:25:022
802099220,1cyclictest1264-21diskmemload22:21:392
802099220,1cyclictest0-21swapper/222:45:412
8016992222,0cyclictest0-21swapper/123:10:041
8016992222,0cyclictest0-21swapper/123:10:041
8016992222,0cyclictest0-21swapper/122:46:281
8016992222,0cyclictest0-21swapper/122:00:151
8016992220,1cyclictest12048-21apt20:25:011
8016992220,1cyclictest0-21swapper/119:15:011
801699220,21cyclictest26502-21latency_hist20:55:011
801699220,21cyclictest23202-21apt-get19:41:541
801699220,21cyclictest12792-21perf19:20:011
801699220,21cyclictest1264-21diskmemload22:40:081
801699220,21cyclictest0-21swapper/122:30:551
801699220,21cyclictest0-21swapper/122:20:191
801699220,21cyclictest0-21swapper/100:30:121
801699220,1cyclictest28521-21sh23:26:421
8011992222,0cyclictest0-21swapper/023:00:380
8011992220,1cyclictest0-21swapper/021:21:220
801199220,22cyclictest0-21swapper/021:46:000
801199220,21cyclictest27653-21sleep19:50:000
801199220,21cyclictest19742-21ssh22:50:260
801199220,21cyclictest17970-21cron19:30:010
801199220,21cyclictest1264-21diskmemload23:15:020
801199220,21cyclictest1264-21diskmemload22:35:140
801199220,21cyclictest0-21swapper/019:21:540
801199220,1cyclictest24912-21sh23:22:050
801199220,0cyclictest0-21swapper/021:55:440
801199220,0cyclictest0-21swapper/000:35:420
8025992120,1cyclictest7628-21apt-get20:16:543
8025992120,0cyclictest25649-21apt-get19:46:543
8025992119,1cyclictest606-21dbus-daemon19:20:013
802599210,0cyclictest0-21swapper/320:31:543
8020992121,0cyclictest1264-21diskmemload21:25:042
8020992121,0cyclictest0-21swapper/220:51:542
8020992120,1cyclictest19697-21ssh22:50:232
8020992120,1cyclictest0-21swapper/220:06:542
8020992119,1cyclictest0-21swapper/219:35:012
802099210,21cyclictest0-21swapper/219:11:532
802099210,20cyclictest393-21apt-get20:01:542
8016992121,0cyclictest0-21swapper/120:31:541
8016992121,0cyclictest0-21swapper/119:31:531
801699210,20cyclictest0-21swapper/120:06:541
8011992119,1cyclictest31300-21sh21:05:010
8020992020,0cyclictest0-21swapper/220:41:542
8020992018,1cyclictest31714-21apt-get21:06:552
8016992020,0cyclictest0-21swapper/120:01:541
8016992020,0cyclictest0-21swapper/119:21:541
8016992018,1cyclictest0-21swapper/119:25:021
801699200,0cyclictest29320-21apt-get21:01:551
801699200,0cyclictest0-21swapper/119:51:541
8011992020,0cyclictest0-21swapper/019:16:530
801199200,0cyclictest0-21swapper/021:06:550
8025991919,0cyclictest0-21swapper/321:01:553
8020991919,0cyclictest0-21swapper/220:36:542
8020991919,0cyclictest0-21swapper/220:31:542
8016991919,0cyclictest0-21swapper/120:36:541
8016991919,0cyclictest0-21swapper/120:11:561
8011991919,0cyclictest0-21swapper/020:56:540
801199190,18cyclictest609-21rs:main0
8025991818,0cyclictest0-21swapper/320:41:543
8025991818,0cyclictest0-21swapper/320:06:543
8025991816,1cyclictest26515-21munin-run20:55:013
8020991818,0cyclictest0-21swapper/219:51:542
8020991818,0cyclictest0-21swapper/219:46:542
8016991818,0cyclictest0-21swapper/120:16:541
8011991818,0cyclictest20391-21perf19:35:010
8011991818,0cyclictest14849-21apt-get20:31:540
8011991818,0cyclictest0-21swapper/020:46:550
8011991818,0cyclictest0-21swapper/020:21:540
8011991816,1cyclictest9649-21dump-pmu-power20:20:010
8020991717,0cyclictest0-21swapper/220:56:542
8016991717,0cyclictest0-21swapper/120:41:541
8025991616,0cyclictest0-21swapper/319:41:543
8025991615,1cyclictest28044-21apt-get19:51:543
8025991612,3cyclictest0-21swapper/321:06:543
8020991616,0cyclictest22058-21apt-get20:46:552
8020991616,0cyclictest0-21swapper/220:21:542
8011991616,0cyclictest0-21swapper/019:41:540
8011991615,1cyclictest20783-21apt-get19:36:530
8011991614,1cyclictest32414-21sendmail20:00:000
8025991513,1cyclictest24119-21munin-run20:50:003
802599150,15cyclictest0-21swapper/320:57:083
8020991515,0cyclictest0-21swapper/219:41:542
8016991515,0cyclictest0-21swapper/119:36:531
8011991515,0cyclictest10392-21perf19:15:010
8011991515,0cyclictest0-21swapper/020:51:540
8011991513,1cyclictest0-21swapper/020:12:050
801199150,14cyclictest12419-21/usr/sbin/munin20:26:550
8025991414,0cyclictest0-21swapper/319:35:133
802599140,14cyclictest0-21swapper/320:25:123
802599140,0cyclictest0-21swapper/320:35:333
8020991414,0cyclictest0-21swapper/220:10:392
802099140,14cyclictest0-21swapper/221:00:352
802099140,14cyclictest0-21swapper/219:36:162
802099140,0cyclictest0-21swapper/220:16:302
801699140,14cyclictest0-21swapper/120:45:271
801699140,14cyclictest0-21swapper/120:25:081
801699140,0cyclictest0-21swapper/119:45:131
8011991414,0cyclictest0-21swapper/020:35:500
8011991414,0cyclictest0-21swapper/020:00:030
8011991414,0cyclictest0-21swapper/019:50:530
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional