You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 07:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun Mar 29, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
792799270,0cyclictest0-21swapper/223:30:592
7927992621,4cyclictest2370-21diskmemload23:06:312
7927992621,4cyclictest0-21swapper/222:30:012
792799260,0cyclictest0-21swapper/223:13:152
792899250,24cyclictest1985-21ssh21:42:153
7927992521,4cyclictest2370-21diskmemload22:34:012
7927992520,4cyclictest11801-21ssh21:18:472
792799250,24cyclictest2811-21ssh23:17:422
792799250,24cyclictest2370-21diskmemload00:40:002
792799250,24cyclictest0-21swapper/223:39:422
792799250,24cyclictest0-21swapper/200:17:392
792799250,22cyclictest9699-21sh22:52:542
792799250,21cyclictest16273-21sh23:29:302
7926992522,2cyclictest28223-21sh22:39:061
792699250,24cyclictest1242-21apt-get20:03:141
792599250,2cyclictest1995-21ssh23:16:190
792599250,24cyclictest2370-21diskmemload22:28:160
792599250,24cyclictest0-21swapper/021:26:150
7928992423,1cyclictest15896-21ssh00:01:353
792899240,23cyclictest2370-21diskmemload23:14:173
792899240,1cyclictest0-21swapper/322:42:173
792899240,0cyclictest2370-21diskmemload00:05:253
7927992420,3cyclictest0-21swapper/200:14:272
7927992419,4cyclictest32394-21ssh21:39:212
792799240,24cyclictest0-21swapper/221:55:552
792799240,23cyclictest1439-21ssh23:48:012
792799240,23cyclictest0-21swapper/222:09:422
792799240,23cyclictest0-21swapper/221:43:292
792799240,21cyclictest0-21swapper/222:11:112
792799240,0cyclictest2370-21diskmemload22:42:092
792799240,0cyclictest0-21swapper/223:53:372
7926992421,2cyclictest29089-21sh23:10:561
792699240,24cyclictest0-21swapper/123:01:571
792699240,1cyclictest0-21swapper/121:57:421
792699240,1cyclictest0-21swapper/121:22:451
792699240,0cyclictest0-21swapper/121:26:581
792599240,24cyclictest0-21swapper/022:59:180
792599240,23cyclictest28035-21sh23:41:400
792599240,23cyclictest0-21swapper/021:19:340
792599240,23cyclictest0-21swapper/019:40:010
792599240,1cyclictest16968-21sh21:56:550
792599240,0cyclictest0-21swapper/022:46:200
7928992323,0cyclictest0-21swapper/322:46:213
7928992323,0cyclictest0-21swapper/322:02:503
7928992323,0cyclictest0-21swapper/321:15:413
7928992323,0cyclictest0-21swapper/300:35:383
7928992322,1cyclictest12914-21ssh23:26:463
7928992322,1cyclictest0-21swapper/321:14:363
7928992321,1cyclictest27614-21perf20:55:003
7928992321,1cyclictest0-21swapper/300:15:443
7928992320,2cyclictest20669-21ssh23:33:223
792899230,23cyclictest2370-21diskmemload23:43:153
792899230,23cyclictest0-21swapper/322:56:183
792899230,23cyclictest0-21swapper/322:35:423
792899230,22cyclictest8858-21ssh00:26:453
792899230,22cyclictest2370-21diskmemload23:50:393
792899230,22cyclictest2370-21diskmemload22:29:073
792899230,1cyclictest2370-21diskmemload21:49:133
792899230,0cyclictest0-21swapper/323:56:463
792899230,0cyclictest0-21swapper/323:24:233
792899230,0cyclictest0-21swapper/322:24:013
792899230,0cyclictest0-21swapper/321:32:573
792899230,0cyclictest0-21swapper/300:33:543
7927992323,0cyclictest28543-21ssh22:39:352
7927992321,2cyclictest0-21swapper/222:01:522
7927992320,3cyclictest0-21swapper/200:31:032
7927992320,2cyclictest0-21swapper/223:55:592
7927992319,3cyclictest2370-21diskmemload00:26:382
792799230,23cyclictest0-21swapper/223:00:252
792799230,23cyclictest0-21swapper/221:32:322
792799230,23cyclictest0-21swapper/221:26:562
792799230,22cyclictest3699-21apt-get20:08:132
792799230,22cyclictest0-21swapper/200:00:372
792799230,0cyclictest2370-21diskmemload22:49:352
792799230,0cyclictest0-21swapper/223:22:102
792799230,0cyclictest0-21swapper/222:57:412
792799230,0cyclictest0-21swapper/221:51:312
792799230,0cyclictest0-21swapper/200:23:572
792799230,0cyclictest0-21swapper/200:08:292
7926992323,0cyclictest2370-21diskmemload22:52:351
7926992323,0cyclictest0-21swapper/123:20:411
7926992323,0cyclictest0-21swapper/122:28:201
7926992323,0cyclictest0-21swapper/122:21:161
7926992323,0cyclictest0-21swapper/100:26:511
7926992322,1cyclictest19201-21ssh22:30:241
7926992321,1cyclictest606-21dbus-daemon19:20:001
7926992321,1cyclictest10192-21ssh21:49:301
7926992321,1cyclictest0-21swapper/121:38:131
7926992320,2cyclictest2392-21grep21:10:011
792699230,2cyclictest5371-21rm22:17:391
792699230,2cyclictest25356-21ssh00:10:361
792699230,23cyclictest2370-21diskmemload00:00:161
792699230,22cyclictest7769-21ssh21:15:051
792699230,22cyclictest2370-21diskmemload23:50:271
792699230,22cyclictest21265-21sh22:00:371
792699230,22cyclictest19003-21ssh00:36:411
792699230,22cyclictest17483-21sh23:31:011
792699230,22cyclictest1717-21ssh23:15:551
792699230,22cyclictest13909-21ssh23:59:021
792699230,22cyclictest13019-21ssh23:26:581
792699230,22cyclictest0-21swapper/121:10:521
792699230,1cyclictest17589-21ssh22:59:431
792699230,0cyclictest0-21swapper/121:34:231
7925992323,0cyclictest0-21swapper/022:40:370
7925992323,0cyclictest0-21swapper/021:47:460
7925992323,0cyclictest0-21swapper/000:36:030
7925992323,0cyclictest0-21swapper/000:30:220
7925992323,0cyclictest0-21swapper/000:12:050
7925992322,1cyclictest0-21swapper/023:34:110
7925992321,1cyclictest32417-21sleep21:05:010
7925992321,1cyclictest30734-21cron19:55:000
7925992321,1cyclictest0-21swapper/023:06:480
7925992321,1cyclictest0-21swapper/022:53:130
7925992321,1cyclictest0-21swapper/000:17:290
7925992320,2cyclictest24094-21sh21:31:580
7925992320,2cyclictest2370-21diskmemload21:43:240
792599230,23cyclictest0-21swapper/022:10:210
792599230,22cyclictest8987-21sh22:20:110
792599230,22cyclictest27684-21ssh22:07:510
792599230,22cyclictest18781-21sh23:00:310
792599230,22cyclictest11436-21sh23:57:440
792599230,22cyclictest0-21swapper/023:53:400
792599230,1cyclictest5824-21ntp_states00:23:190
792599230,1cyclictest12808-21latency_hist20:25:010
792599230,0cyclictest2370-21diskmemload23:46:420
792599230,0cyclictest0-21swapper/022:36:250
792599230,0cyclictest0-21swapper/021:20:080
792599230,0cyclictest0-21swapper/000:00:050
7928992222,0cyclictest0-21swapper/323:15:093
7928992222,0cyclictest0-21swapper/322:53:003
7928992222,0cyclictest0-21swapper/322:09:163
7928992222,0cyclictest0-21swapper/321:51:353
7928992221,1cyclictest2370-21diskmemload23:00:303
7928992221,1cyclictest0-21swapper/321:20:123
7928992221,1cyclictest0-21swapper/300:11:203
7928992220,1cyclictest3210-21munin-run20:05:003
7928992220,1cyclictest2370-21diskmemload21:25:133
7928992220,1cyclictest0-21swapper/321:00:013
792899220,21cyclictest30516-21apt-get21:03:133
792899220,21cyclictest23515-21munin-run19:40:013
792899220,21cyclictest18102-21apt-get20:38:133
792899220,21cyclictest11207-21apt-get19:18:133
792899220,21cyclictest10303-21cron19:15:003
792899220,21cyclictest0-21swapper/323:08:133
792899220,21cyclictest0-21swapper/320:25:013
792899220,1cyclictest31095-21sh22:10:083
792899220,1cyclictest21900-21ssh23:35:023
792899220,1cyclictest0-21swapper/322:15:103
792899220,1cyclictest0-21swapper/321:55:133
7927992222,0cyclictest0-21swapper/221:14:012
7927992220,2cyclictest2370-21diskmemload22:15:392
7927992220,2cyclictest0-21swapper/223:40:452
7927992220,2cyclictest0-21swapper/222:22:052
792799220,21cyclictest13309-21apt-get20:28:122
792799220,1cyclictest29150-1kworker/u9:021:22:172
7926992222,0cyclictest2370-21diskmemload22:40:191
7926992222,0cyclictest0-21swapper/123:43:061
7926992222,0cyclictest0-21swapper/122:09:141
7926992220,1cyclictest2109-21sh21:42:261
7926992220,1cyclictest0-21swapper/100:31:371
792699220,22cyclictest2370-21diskmemload22:45:401
792699220,22cyclictest2370-21diskmemload00:15:511
792699220,21cyclictest31322-21rm22:10:281
792699220,21cyclictest2370-21diskmemload23:05:021
792699220,21cyclictest20518-21apt-get20:43:111
792699220,21cyclictest20288-21ssh00:05:291
792699220,21cyclictest0-21swapper/120:23:121
792699220,1cyclictest4453-21cron23:50:001
792699220,1cyclictest0-21swapper/119:45:001
792699220,1cyclictest0-21swapper/100:23:011
7925992222,0cyclictest0-21swapper/022:34:130
7925992222,0cyclictest0-21swapper/021:51:100
7925992222,0cyclictest0-21swapper/019:43:120
7925992221,1cyclictest2370-21diskmemload23:23:540
7925992221,1cyclictest0-21swapper/023:36:130
7925992220,1cyclictest28361-21munin-run19:50:000
7925992220,1cyclictest20008-21perf20:40:000
7925992220,1cyclictest0-21swapper/022:15:580
792599220,22cyclictest62550irq/127-eno100:25:210
792599220,22cyclictest2370-21diskmemload23:27:180
792599220,21cyclictest28847-21ssh23:10:340
792599220,21cyclictest16016-21apt-get19:28:120
792599220,21cyclictest10418-21munin-run20:20:010
792599220,21cyclictest0-21swapper/021:10:420
792599220,1cyclictest27573-21cron20:55:000
792599220,1cyclictest0-21swapper/022:00:570
792599220,1cyclictest0-21swapper/000:05:400
7928992121,0cyclictest0-21swapper/323:45:153
7928992120,1cyclictest2370-21diskmemload00:23:013
792899210,21cyclictest23905-21apt-config19:41:563
792899210,20cyclictest0-21swapper/320:28:123
792899210,20cyclictest0-21swapper/319:23:113
792899210,0cyclictest28367-21ssh21:35:413
792799210,1cyclictest20716-21munin-run19:35:012
792799210,0cyclictest0-21swapper/220:18:112
792799210,0cyclictest0-21swapper/219:53:132
7926992121,0cyclictest0-21swapper/119:28:121
7926992120,1cyclictest8499-21apt-get20:18:121
7926992120,1cyclictest31245-21apt-get19:58:121
7926992118,2cyclictest17576-21cron20:35:001
792699210,21cyclictest0-21swapper/123:35:381
7925992120,1cyclictest0-21swapper/019:15:020
7925992119,1cyclictest5602-21perf20:10:010
7928992020,0cyclictest0-21swapper/319:55:003
792899200,0cyclictest0-21swapper/321:08:133
7927992020,0cyclictest10313-21apt-get19:15:022
7927992020,0cyclictest0-21swapper/221:03:132
7927992020,0cyclictest0-21swapper/220:43:122
7927992020,0cyclictest0-21swapper/219:43:122
7927992020,0cyclictest0-21swapper/219:28:122
7927992020,0cyclictest0-21swapper/219:23:112
7927992016,4cyclictest10916-21apt-get20:23:112
7926992018,1cyclictest17907-21apt-get19:30:021
792699200,0cyclictest0-21swapper/119:48:141
7925992020,0cyclictest22409-21apt-get20:45:020
7925992020,0cyclictest0-21swapper/020:13:110
792599200,0cyclictest0-21swapper/020:33:130
7928991919,0cyclictest0-21swapper/319:33:123
7928991918,0cyclictest26457-21apt-get19:48:143
7927991919,0cyclictest8413-21apt-get19:13:122
7927991919,0cyclictest15708-21apt-get20:33:132
7927991919,0cyclictest0-21swapper/220:53:122
7927991917,1cyclictest2377-21cron21:10:012
792799190,18cyclictest23494-21idleruntime-cro19:40:012
7926991919,0cyclictest0-21swapper/121:03:131
7926991919,0cyclictest0-21swapper/119:35:021
7926991918,1cyclictest6095-21apt-get20:13:111
792699190,2cyclictest0-21swapper/119:53:131
7925991919,0cyclictest0-21swapper/021:08:130
7925991917,1cyclictest10296-21latency_hist19:15:000
792899180,17cyclictest0-21swapper/320:08:133
7927991818,0cyclictest0-21swapper/220:03:132
7927991818,0cyclictest0-21swapper/219:58:122
7925991818,0cyclictest0-21swapper/020:28:120
7925991818,0cyclictest0-21swapper/020:03:130
7927991714,3cyclictest0-21swapper/220:48:132
7926991716,0cyclictest28099-21apt-get20:58:121
792699170,16cyclictest10290-21cron19:15:001
7925991717,0cyclictest0-21swapper/020:58:120
7928991616,0cyclictest23309-21apt-get20:48:133
7927991612,3cyclictest0-21swapper/219:48:142
7926991616,0cyclictest0-21swapper/119:23:111
7925991616,0cyclictest0-21swapper/019:30:020
792599160,15cyclictest505-21users19:58:210
7927991514,1cyclictest0-21swapper/220:55:292
7927991513,1cyclictest0-21swapper/220:38:152
792699154,4cyclictest0-21swapper/120:53:111
7926991514,1cyclictest0-21swapper/120:45:021
792899140,14cyclictest0-21swapper/320:41:363
792899140,14cyclictest0-21swapper/319:25:393
792899140,0cyclictest0-21swapper/320:31:083
792899140,0cyclictest0-21swapper/320:17:023
792899140,0cyclictest0-21swapper/320:10:163
792899140,0cyclictest0-21swapper/319:56:363
7927991414,0cyclictest0-21swapper/220:11:312
7926991414,0cyclictest0-21swapper/120:25:321
792699140,14cyclictest0-21swapper/120:35:011
792699140,14cyclictest0-21swapper/120:06:101
792599140,0cyclictest0-21swapper/020:40:320
792599140,0cyclictest0-21swapper/019:20:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional