You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 13:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Sep 22, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2518199280,1cyclictest0-21swapper/300:12:213
2518199270,23cyclictest19233-21diskmemload22:35:093
2518199270,21cyclictest0-21swapper/321:42:543
2518199263,22cyclictest11931-21cron19:50:003
25181992623,3cyclictest0-21swapper/322:01:533
2518199260,25cyclictest29097-21ssh21:47:533
2518199260,25cyclictest19394-21ssh00:32:183
2518199260,1cyclictest2500-21perl23:47:553
2518099260,22cyclictest151rcu_preempt23:58:502
25179992624,1cyclictest0-21swapper/122:23:011
25181992523,1cyclictest13207-21dump-pmu-power22:30:013
25181992520,4cyclictest5125-21sh21:26:093
2518199250,24cyclictest31899-21sh23:44:463
2518199250,24cyclictest16297-21ssh23:02:553
2518199250,24cyclictest16297-21ssh23:02:553
2518199250,24cyclictest0-21swapper/300:29:213
2518199250,21cyclictest0-21swapper/323:30:443
2518199250,1cyclictest6724-21sh00:20:143
2518199250,1cyclictest12086-21ssh23:27:453
2517999250,24cyclictest0-21swapper/120:12:551
2517899250,25cyclictest0-21swapper/022:07:130
25181992422,1cyclictest0-21swapper/323:58:133
2518199240,23cyclictest19233-21diskmemload23:21:323
2518199240,23cyclictest0-21swapper/321:10:033
25180992422,1cyclictest0-21swapper/200:15:352
2518099240,23cyclictest0-21swapper/200:28:102
2518099240,1cyclictest19233-21diskmemload00:34:262
25179992423,1cyclictest0-21swapper/122:50:581
2517999240,24cyclictest0-21swapper/123:30:111
2517999240,23cyclictest32628-21sh23:45:331
2517999240,23cyclictest18768-21apt-get00:02:541
2517999240,23cyclictest0-21swapper/123:23:531
2517999240,1cyclictest9249-21ssh22:55:461
2517999240,1cyclictest0-21swapper/122:09:191
25178992423,1cyclictest6992-21ssh00:20:340
25178992423,1cyclictest2998-21ssh23:18:150
2517899240,24cyclictest19233-21diskmemload22:00:220
2517899240,24cyclictest0-21swapper/022:57:190
25181992323,0cyclictest0-21swapper/322:46:183
25181992320,3cyclictest19650-21apt-get20:07:573
25181992320,3cyclictest0-21swapper/323:53:543
25181992320,3cyclictest0-21swapper/322:12:123
25181992319,3cyclictest0-21swapper/319:22:533
2518199230,23cyclictest19233-21diskmemload23:10:213
2518199230,23cyclictest0-21swapper/322:30:413
2518199230,22cyclictest2364-21apt-get21:52:543
2518199230,22cyclictest20577-21sh22:07:583
2518199230,22cyclictest19233-21diskmemload21:55:163
2518199230,20cyclictest0-21swapper/323:36:593
2518199230,0cyclictest19233-21diskmemload22:53:283
2518199230,0cyclictest19233-21diskmemload21:17:013
25180992323,0cyclictest0-21swapper/222:49:132
25180992323,0cyclictest0-21swapper/222:16:472
25180992323,0cyclictest0-21swapper/222:01:222
25180992323,0cyclictest0-21swapper/200:39:182
25180992321,1cyclictest0-21swapper/223:31:262
25180992320,2cyclictest7666-21diskmemload00:21:352
25180992320,2cyclictest14025-21munin-plugin-st23:00:002
2518099230,23cyclictest0-21swapper/223:16:102
2518099230,23cyclictest0-21swapper/222:25:542
2518099230,23cyclictest0-21swapper/222:21:402
2518099230,23cyclictest0-21swapper/222:07:482
2518099230,22cyclictest5954-21ssh21:27:202
2518099230,22cyclictest28676-21rm22:43:252
2518099230,22cyclictest21609-21ssh23:07:382
2518099230,22cyclictest19233-21diskmemload22:13:542
2518099230,22cyclictest1108-21ssh23:46:532
2518099230,22cyclictest0-21swapper/223:40:122
2518099230,22cyclictest0-21swapper/200:11:222
2518099230,0cyclictest19233-21diskmemload23:24:462
25179992321,1cyclictest9634-21needreboot00:23:001
25179992321,1cyclictest23265-21ssh00:35:011
25179992321,1cyclictest0-21swapper/123:16:391
25179992320,2cyclictest31563-21sh23:44:201
25179992320,2cyclictest23765-21sh00:07:111
2517999230,23cyclictest12519-21ssh23:57:011
2517999230,22cyclictest9572-21sh22:27:261
2517999230,22cyclictest0-21swapper/122:10:181
2517999230,22cyclictest0-21swapper/122:04:001
2517999230,22cyclictest0-21swapper/100:26:481
2517999230,0cyclictest0-21swapper/121:58:581
2517999230,0cyclictest0-21swapper/121:33:391
2517999230,0cyclictest0-21swapper/100:31:421
25178992323,0cyclictest19233-21diskmemload21:35:060
25178992323,0cyclictest0-21swapper/022:53:010
25178992323,0cyclictest0-21swapper/022:26:090
25178992323,0cyclictest0-21swapper/022:16:310
25178992323,0cyclictest0-21swapper/021:55:470
25178992323,0cyclictest0-21swapper/000:10:190
25178992321,1cyclictest30582-21ssh23:14:180
2517899230,23cyclictest19233-21diskmemload21:31:020
2517899230,23cyclictest19233-21diskmemload21:16:010
2517899230,23cyclictest19233-21diskmemload00:18:340
2517899230,23cyclictest0-21swapper/023:36:370
2517899230,23cyclictest0-21swapper/000:06:210
2517899230,22cyclictest782-21ntp_kernel_err22:47:590
2517899230,22cyclictest28161-21sh23:42:050
2517899230,22cyclictest27727-21sh21:46:020
2517899230,22cyclictest24225-21cron22:40:000
2517899230,22cyclictest23676-21ssh00:35:320
2517899230,22cyclictest19233-21diskmemload21:21:000
2517899230,22cyclictest15920-21rm23:30:270
2517899230,22cyclictest0-21swapper/023:00:170
2517899230,22cyclictest0-21swapper/023:00:170
2517899230,1cyclictest24461-21ssh22:11:410
2517899230,0cyclictest19233-21diskmemload21:28:240
2517899230,0cyclictest0-21swapper/023:49:130
2517899230,0cyclictest0-21swapper/022:32:020
25181992222,0cyclictest19233-21diskmemload22:21:183
25181992222,0cyclictest0-21swapper/321:33:003
25181992220,2cyclictest0-21swapper/322:15:313
25181992220,2cyclictest0-21swapper/300:06:313
25181992220,1cyclictest0-21swapper/323:15:033
25181992220,1cyclictest0-21swapper/300:35:183
25181992218,4cyclictest29521-21ssh22:44:393
2518199220,21cyclictest4894-21apt-get20:42:543
2518199220,21cyclictest19233-21diskmemload21:20:043
2518199220,21cyclictest15645-21ssh21:35:213
2518199220,21cyclictest0-21swapper/321:02:543
2518199220,1cyclictest17972-21ssh00:01:473
25180992222,0cyclictest0-21swapper/221:46:092
25180992221,1cyclictest0-21swapper/223:39:202
25180992220,2cyclictest19616-21ssh21:10:102
25180992220,1cyclictest0-21swapper/223:25:182
25180992220,1cyclictest0-21swapper/221:55:012
25180992220,1cyclictest0-21swapper/221:21:522
2518099220,22cyclictest0-21swapper/221:15:312
2518099220,21cyclictest19233-21diskmemload22:50:522
2518099220,21cyclictest18172-21smartctl21:38:012
2518099220,21cyclictest0-21swapper/222:31:592
2518099220,21cyclictest0-21swapper/221:51:342
2518099220,21cyclictest0-21swapper/221:30:202
2518099220,21cyclictest0-21swapper/219:15:012
2518099220,21cyclictest0-21swapper/200:00:162
25179992222,0cyclictest0-21swapper/123:11:531
25179992222,0cyclictest0-21swapper/123:02:321
25179992222,0cyclictest0-21swapper/123:02:321
25179992222,0cyclictest0-21swapper/122:18:141
25179992222,0cyclictest0-21swapper/121:16:431
25179992221,1cyclictest11961-21apt19:50:001
25179992220,1cyclictest31642-21awk20:30:001
25179992220,1cyclictest0-21swapper/123:05:051
25179992220,1cyclictest0-21swapper/122:42:391
25179992220,1cyclictest0-21swapper/121:35:101
2517999220,22cyclictest20673-21ssh22:37:291
2517999220,21cyclictest4419-21perf20:40:001
2517999220,21cyclictest0-21swapper/120:45:021
2517999220,21cyclictest0-21swapper/119:17:551
2517999220,1cyclictest6769-21ssh23:51:511
2517999220,1cyclictest527-21ssh22:47:581
25178992222,0cyclictest19233-21diskmemload00:30:010
25178992222,0cyclictest19233-21diskmemload00:29:120
25178992222,0cyclictest0-21swapper/021:14:160
25178992221,0cyclictest32238-21apt-get20:30:020
25178992220,1cyclictest19257-21ls21:10:000
2517899220,22cyclictest0-21swapper/020:42:540
2517899220,21cyclictest4641-21ssh23:20:150
2517899220,21cyclictest2461-21ssh22:20:370
2517899220,21cyclictest19233-21diskmemload21:40:060
2517899220,21cyclictest16984-21ssh00:00:200
2517899220,21cyclictest0-21swapper/022:40:340
2517899220,1cyclictest697-21ssh21:50:440
2517899220,1cyclictest14089-21ssh23:28:150
2517899220,1cyclictest12298-21diskmemload23:56:440
2517899220,1cyclictest0-21swapper/023:09:360
2517899220,0cyclictest19233-21diskmemload23:53:240
25181992120,1cyclictest28040-21apt-get19:17:553
25181992120,0cyclictest0-21swapper/320:37:553
25180992121,0cyclictest19233-21diskmemload23:01:012
25180992121,0cyclictest19233-21diskmemload23:01:012
25180992121,0cyclictest0-21swapper/221:41:132
25180992121,0cyclictest0-21swapper/220:25:022
25180992120,1cyclictest10129-21apt-get20:52:542
25180992119,1cyclictest22043-21apt-get20:12:552
25180992119,1cyclictest0-21swapper/222:35:112
2518099210,21cyclictest0-21swapper/223:50:232
2518099210,20cyclictest2480-21apt-get20:37:552
2518099210,20cyclictest2348-21dump-pmu-power19:30:002
2518099210,20cyclictest0-21swapper/223:10:022
2518099210,20cyclictest0-21swapper/219:57:522
2518099210,1cyclictest32375-21wc19:25:002
25179992121,0cyclictest0-21swapper/100:10:021
25179992119,1cyclictest4583-21ssh21:25:281
25179992119,1cyclictest0-21swapper/122:30:391
2517999210,21cyclictest0-21swapper/121:10:051
2517999210,21cyclictest0-21swapper/100:15:101
2517999210,0cyclictest0-21swapper/121:52:331
25178992121,0cyclictest0-21swapper/019:37:550
25181992020,0cyclictest12436-21apt-get19:52:533
25181992020,0cyclictest0-21swapper/320:22:543
25181992018,1cyclictest7137-21cron19:40:003
2518199200,19cyclictest0-21swapper/320:17:533
25180992020,0cyclictest14941-21apt-get21:02:542
25180992020,0cyclictest0-21swapper/220:45:022
25180992020,0cyclictest0-21swapper/219:52:532
25180992020,0cyclictest0-21swapper/219:32:542
25179992020,0cyclictest0-21swapper/120:22:541
25179992020,0cyclictest0-21swapper/120:17:531
25178992020,0cyclictest0-21swapper/020:22:540
25178992020,0cyclictest0-21swapper/020:07:570
25178992018,1cyclictest606-21dbus-daemon19:50:000
25181991919,0cyclictest17247-21apt-get20:02:523
25181991919,0cyclictest0-21swapper/320:45:103
25181991919,0cyclictest0-21swapper/320:32:543
25181991918,1cyclictest12062-21munin-run20:55:013
25181991915,3cyclictest0-21swapper/319:42:553
25181991914,4cyclictest0-21swapper/319:57:593
2518199190,4cyclictest0-21swapper/320:30:013
25180991919,0cyclictest0-21swapper/220:07:572
25180991919,0cyclictest0-21swapper/219:42:552
25180991918,1cyclictest26917-21apt-get20:22:542
25180991917,1cyclictest12524-21apt-get20:57:532
25179991919,0cyclictest0-21swapper/119:15:011
25178991919,0cyclictest30456-21apt-get19:22:530
25178991919,0cyclictest0-21swapper/020:47:540
25178991917,1cyclictest313-21systemd-journal21:05:000
25181991816,1cyclictest606-21dbus-daemon21:10:003
25180991818,0cyclictest0-21swapper/220:02:522
25180991817,1cyclictest32494-21apt-get20:32:542
25180991817,0cyclictest0-21swapper/219:37:552
25179991818,0cyclictest2838-21apt-get19:32:541
25179991818,0cyclictest0-21swapper/119:27:521
25179991818,0cyclictest0-21swapper/119:22:531
25179991816,1cyclictest9580-21munin-run19:45:001
2517999180,1cyclictest0-21swapper/119:55:011
2517999180,0cyclictest0-21swapper/119:57:521
25178991818,0cyclictest0-21swapper/020:27:540
25178991818,0cyclictest0-21swapper/019:52:410
2517899180,18cyclictest0-21swapper/019:42:550
2517899180,15cyclictest4447-21sed20:40:000
25181991716,1cyclictest386-21apt-get19:27:523
25181991716,1cyclictest0-21swapper/320:57:533
25179991717,0cyclictest0-21swapper/120:07:571
25179991714,2cyclictest19159-21cron20:05:011
25178991714,2cyclictest29945-21cron19:20:010
25179991616,0cyclictest0-21swapper/120:52:541
25179991616,0cyclictest0-21swapper/119:37:541
25179991614,1cyclictest31611-21apt-get20:30:011
25181991513,1cyclictest3640-21irqstats19:32:583
2518199150,15cyclictest0-21swapper/319:13:243
25180991515,0cyclictest17335-21apt-get21:07:552
25180991515,0cyclictest0-21swapper/219:47:542
25180991515,0cyclictest0-21swapper/219:17:542
25178991515,0cyclictest14831-21apt-get19:57:520
25178991515,0cyclictest0-21swapper/020:52:540
25178991513,1cyclictest23142-21ntp_states20:13:000
2517899150,1cyclictest26685-21ntp_states19:12:570
2518199140,0cyclictest0-21swapper/320:11:173
25180991414,0cyclictest0-21swapper/220:15:092
2518099140,14cyclictest0-21swapper/220:40:222
25179991414,0cyclictest0-21swapper/120:55:171
25179991414,0cyclictest0-21swapper/120:40:281
2517999140,14cyclictest0-21swapper/121:05:121
2517999140,14cyclictest0-21swapper/121:00:191
25178991414,0cyclictest0-21swapper/020:15:430
25178991414,0cyclictest0-21swapper/019:30:060
2517899140,14cyclictest0-21swapper/020:55:100
2517899140,14cyclictest0-21swapper/019:25:110
2517899140,0cyclictest0-21swapper/020:00:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional