You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Dec 27, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4362114103,6sleep00-21swapper/019:09:110
32734211496,12sleep20-21swapper/219:07:012
32730210988,16sleep30-21swapper/319:06:573
32713210796,6sleep10-21swapper/119:06:441
2261421070,1sleep322615-21cat00:25:253
2261421070,1sleep322615-21cat00:25:253
163492840,2sleep339-21ksoftirqd/321:46:003
153782770,0sleep30-21swapper/323:00:403
153782770,0sleep30-21swapper/323:00:393
206882750,0sleep00-21swapper/023:07:410
17452720,2sleep11748-21processes20:30:201
52899373,33cyclictest526-21cyclictest21:40:101
53099330,19cyclictest39-21ksoftirqd/321:25:103
52899320,9cyclictest0-21swapper/121:25:111
53099229,11cyclictest0-21swapper/322:20:143
53099220,20cyclictest0-21swapper/300:35:113
52899221,19cyclictest0-21swapper/122:00:121
220092220,0sleep00-21swapper/021:53:430
139672220,0sleep20-21swapper/223:00:152
139672220,0sleep20-21swapper/223:00:142
53099210,19cyclictest25632-21ssh00:30:113
529992117,2cyclictest0-21swapper/223:10:132
52999210,19cyclictest0-21swapper/223:25:122
52999201,2cyclictest0-21swapper/222:25:132
52999201,17cyclictest0-21swapper/220:20:102
528992017,2cyclictest0-21swapper/119:45:131
52799200,18cyclictest0-21swapper/023:50:120
52999190,14cyclictest0-21swapper/222:34:042
530991712,3cyclictest6853-21nscd23:41:403
529991714,2cyclictest7910-21kworker/u8:221:40:042
529991714,2cyclictest5847-21kworker/u8:020:42:052
529991714,2cyclictest27430-21kworker/u8:022:08:042
529991714,2cyclictest19787-21kworker/u8:222:56:042
529991714,2cyclictest16212-21kworker/u8:123:22:052
529991714,2cyclictest16212-21kworker/u8:123:22:042
529991714,2cyclictest11920-21kworker/u8:100:18:052
52999170,12cyclictest0-21swapper/220:16:052
53099160,2cyclictest0-21swapper/321:13:053
53099160,2cyclictest0-21swapper/321:13:043
53099160,14cyclictest0-21swapper/323:12:563
529991613,2cyclictest9223-21kworker/u8:123:34:052
529991613,2cyclictest794-21kworker/u8:122:14:052
529991613,2cyclictest7910-21kworker/u8:221:52:052
529991613,2cyclictest7322-21kworker/u8:000:21:032
529991613,2cyclictest24186-21kworker/u8:123:55:042
529991613,2cyclictest21424-21kworker/u8:100:27:052
529991613,2cyclictest21424-21kworker/u8:100:27:042
529991613,2cyclictest21156-21kworker/u8:023:09:032
529991613,2cyclictest1403-21kworker/u8:119:22:042
529991613,2cyclictest1403-21kworker/u8:119:17:042
52999161,13cyclictest0-21swapper/221:55:122
529991611,3cyclictest0-21swapper/221:00:192
52999161,12cyclictest0-21swapper/221:20:052
528991613,2cyclictest16831-21diskmemload23:20:321
528991613,2cyclictest16831-21diskmemload23:20:311
52899161,13cyclictest16831-21diskmemload22:26:521
52899160,14cyclictest0-21swapper/123:15:111
52899160,14cyclictest0-21swapper/122:51:121
527991611,3cyclictest0-21swapper/020:25:140
52799160,14cyclictest0-21swapper/000:35:030
53099151,2cyclictest0-21swapper/322:03:053
530991512,2cyclictest4332-21kworker/u8:223:38:043
53099151,12cyclictest0-21swapper/322:48:513
53099150,13cyclictest0-21swapper/323:30:113
53099150,13cyclictest0-21swapper/322:35:553
53099150,13cyclictest0-21swapper/300:11:453
52999151,3cyclictest0-21swapper/222:40:252
529991512,2cyclictest8499-21kworker/u8:020:08:052
529991512,2cyclictest4892-21kworker/u8:219:46:042
529991512,2cyclictest19787-21kworker/u8:222:53:052
529991512,2cyclictest19787-21kworker/u8:222:35:052
529991512,2cyclictest1403-21kworker/u8:119:12:042
52999150,3cyclictest0-21swapper/200:31:212
52999150,10cyclictest0-21swapper/200:07:052
52899152,7cyclictest0-21swapper/122:00:001
528991512,2cyclictest0-21swapper/121:47:211
528991510,3cyclictest0-21swapper/121:53:331
52899150,13cyclictest25188-21copy21:20:011
52899150,13cyclictest16831-21diskmemload22:59:011
52899150,13cyclictest16831-21diskmemload00:18:121
52899150,13cyclictest0-21swapper/123:47:031
52899150,12cyclictest0-21swapper/122:15:181
52799150,14cyclictest0-21swapper/021:15:440
136972150,3sleep013704-21sh21:44:010
96102140,1sleep00-21swapper/022:16:120
53099144,7cyclictest526-21cyclictest20:15:253
530991411,2cyclictest794-21kworker/u8:122:25:053
530991411,2cyclictest7910-21kworker/u8:221:38:053
530991411,2cyclictest0-21swapper/322:10:553
530991411,2cyclictest0-21swapper/300:03:563
53099140,2cyclictest0-21swapper/323:07:463
53099140,2cyclictest0-21swapper/322:50:413
53099140,13cyclictest0-21swapper/322:07:143
53099140,13cyclictest0-21swapper/321:40:143
53099140,12cyclictest5568-21munin-node3
53099140,12cyclictest0-21swapper/321:33:403
53099140,12cyclictest0-21swapper/300:20:103
53099140,12cyclictest0-21swapper/300:18:003
52999149,3cyclictest8874-21latency_hist19:30:002
52999141,2cyclictest32523-21apt-get00:00:112
529991411,2cyclictest8499-21kworker/u8:020:04:052
529991411,2cyclictest5847-21kworker/u8:020:47:042
529991411,2cyclictest22807-21kworker/u8:221:27:042
529991411,2cyclictest0-21swapper/222:23:442
529991411,2cyclictest0-21swapper/221:12:552
529991411,2cyclictest0-21swapper/221:12:542
52999140,3cyclictest0-21swapper/223:15:132
52999140,2cyclictest0-21swapper/222:47:442
52999140,2cyclictest0-21swapper/219:55:032
52999140,12cyclictest16831-21diskmemload21:49:362
52999140,12cyclictest0-21swapper/223:45:572
52899149,3cyclictest8100-21sensors20:45:231
52899142,6cyclictest0-21swapper/121:40:011
52899141,2cyclictest16831-21diskmemload22:10:201
528991411,2cyclictest16831-21diskmemload23:30:521
528991411,2cyclictest0-21swapper/122:33:511
528991411,2cyclictest0-21swapper/122:23:311
52899141,10cyclictest0-21swapper/122:05:261
528991410,2cyclictest0-21swapper/121:14:121
528991410,2cyclictest0-21swapper/121:14:111
52899140,2cyclictest0-21swapper/121:34:011
52899140,12cyclictest16831-21diskmemload00:32:031
52899140,12cyclictest0-21swapper/123:27:331
52899140,12cyclictest0-21swapper/119:40:201
52799141,9cyclictest7427-21metacity19:16:590
527991411,2cyclictest16831-21diskmemload00:30:430
527991411,2cyclictest0-21swapper/023:37:330
527991411,2cyclictest0-21swapper/022:30:140
527991411,2cyclictest0-21swapper/021:48:430
527991411,2cyclictest0-21swapper/020:45:140
527991411,2cyclictest0-21swapper/000:22:040
527991411,2cyclictest0-21swapper/000:19:030
52799140,2cyclictest526-21cyclictest21:38:540
52799140,13cyclictest16831-21diskmemload21:11:240
52799140,13cyclictest16831-21diskmemload21:11:230
52799140,13cyclictest0-21swapper/023:16:330
52799140,13cyclictest0-21swapper/021:30:430
52799140,12cyclictest21143-21apt-get20:00:110
52799140,12cyclictest0-21swapper/022:36:240
28242140,2sleep00-21swapper/000:02:500
53099138,3cyclictest15483-21cut19:45:153
530991310,2cyclictest22807-21kworker/u8:221:19:043
530991310,2cyclictest19714-21ssh23:45:093
530991310,2cyclictest16831-21diskmemload21:20:163
530991310,2cyclictest1403-21kworker/u8:119:25:053
530991310,2cyclictest0-21swapper/323:56:553
530991310,2cyclictest0-21swapper/323:15:393
530991310,2cyclictest0-21swapper/322:40:233
530991310,2cyclictest0-21swapper/320:35:123
53099130,2cyclictest0-21swapper/323:51:363
53099130,2cyclictest0-21swapper/323:25:273
53099130,2cyclictest0-21swapper/322:55:233
53099130,2cyclictest0-21swapper/322:15:193
53099130,1cyclictest0-21swapper/300:05:463
53099130,12cyclictest0-21swapper/321:51:103
53099130,12cyclictest0-21swapper/321:05:163
53099130,11cyclictest0-21swapper/323:20:083
53099130,11cyclictest0-21swapper/323:20:073
52999138,3cyclictest0-21swapper/200:38:482
529991310,2cyclictest8499-21kworker/u8:020:11:042
529991310,2cyclictest8499-21kworker/u8:019:40:052
529991310,2cyclictest8499-21kworker/u8:019:33:052
529991310,2cyclictest25797-21kworker/u8:220:51:052
529991310,2cyclictest16831-21diskmemload23:51:272
529991310,2cyclictest0-21swapper/221:16:142
529991310,2cyclictest0-21swapper/220:55:122
529991310,2cyclictest0-21swapper/219:50:182
52999130,9cyclictest0-21swapper/221:06:052
52999130,2cyclictest0-21swapper/223:36:042
52999130,2cyclictest0-21swapper/222:16:012
52999130,2cyclictest0-21swapper/221:37:352
52999130,2cyclictest0-21swapper/221:32:242
52999130,12cyclictest0-21swapper/222:01:362
52899138,3cyclictest0-21swapper/120:05:161
52899138,3cyclictest0-21swapper/119:20:121
52899132,6cyclictest0-21swapper/122:50:001
52899132,6cyclictest0-21swapper/121:05:001
52899132,6cyclictest0-21swapper/120:40:001
52899132,6cyclictest0-21swapper/120:15:001
52899131,9cyclictest0-21swapper/119:25:141
52899131,3cyclictest25414-21iostat_ios22:35:171
52899131,10cyclictest0-21swapper/120:20:121
528991310,2cyclictest16831-21diskmemload23:02:441
528991310,2cyclictest16831-21diskmemload23:02:441
528991310,2cyclictest0-21swapper/123:51:241
528991310,2cyclictest0-21swapper/123:14:221
528991310,2cyclictest0-21swapper/122:40:021
528991310,2cyclictest0-21swapper/121:16:421
52899130,2cyclictest0-21swapper/123:58:541
52899130,2cyclictest0-21swapper/123:44:231
52899130,2cyclictest0-21swapper/120:15:131
52899130,2cyclictest0-21swapper/100:37:041
52899130,11cyclictest0-21swapper/123:05:131
52899130,11cyclictest0-21swapper/120:55:221
527991310,2cyclictest0-21swapper/023:47:040
527991310,2cyclictest0-21swapper/023:26:230
527991310,2cyclictest0-21swapper/022:21:130
527991310,2cyclictest0-21swapper/021:29:540
52799130,2cyclictest0-21swapper/023:01:040
52799130,2cyclictest0-21swapper/023:01:030
52799130,2cyclictest0-21swapper/000:13:530
52799130,12cyclictest0-21swapper/023:34:340
52799130,12cyclictest0-21swapper/023:12:140
52799130,12cyclictest0-21swapper/022:49:030
52799130,12cyclictest0-21swapper/022:14:230
52799130,12cyclictest0-21swapper/000:07:240
52799130,11cyclictest28284-21swap20:15:260
52799130,11cyclictest16831-21diskmemload21:56:140
52799130,11cyclictest0-21swapper/021:20:040
250792130,1sleep325081-21ssh21:56:253
53099129,2cyclictest8499-21kworker/u8:019:37:053
53099129,2cyclictest0-21swapper/322:30:323
53099129,2cyclictest0-21swapper/320:50:173
53099129,2cyclictest0-21swapper/320:25:203
53099127,3cyclictest29343-21aten2.4_r3power20:20:113
53099120,11cyclictest0-21swapper/319:55:203
52999129,2cyclictest0-21swapper/220:25:192
52999120,2cyclictest0-21swapper/223:40:192
52899129,2cyclictest0-21swapper/100:20:531
52899129,2cyclictest0-21swapper/100:06:121
52899121,9cyclictest21383-21apt00:25:121
52899121,9cyclictest21383-21apt00:25:111
52899121,9cyclictest21140-21munin-node1
52899121,9cyclictest0-21swapper/119:35:231
52899120,2cyclictest0-21swapper/123:36:521
52899120,2cyclictest0-21swapper/120:40:131
52899120,11cyclictest0-21swapper/121:05:211
52899120,11cyclictest0-21swapper/119:55:021
52899120,11cyclictest0-21swapper/100:10:431
52799129,2cyclictest23149-21apt-get20:05:100
52799129,2cyclictest0-21swapper/023:40:340
52799122,7cyclictest0-21swapper/021:03:010
52799122,7cyclictest0-21swapper/020:41:590
52799122,7cyclictest0-21swapper/020:13:010
52799122,7cyclictest0-21swapper/019:23:020
52799120,11cyclictest0-21swapper/022:00:050
52799120,11cyclictest0-21swapper/019:35:110
52799120,10cyclictest0-21swapper/022:55:530
321462121,7sleep00-21swapper/022:05:180
180152120,1sleep00-21swapper/022:25:580
53099118,2cyclictest8499-21kworker/u8:020:07:053
53099118,2cyclictest4892-21kworker/u8:219:51:053
53099118,2cyclictest1403-21kworker/u8:119:11:043
53099118,2cyclictest0-21swapper/319:40:013
53099118,2cyclictest0-21swapper/319:30:143
52999111,7cyclictest6318-21Xorg19:38:582
52999110,8cyclictest0-21swapper/220:30:022
52999110,1cyclictest0-21swapper/200:10:212
52899116,3cyclictest747-21munin-node1
52899111,6cyclictest0-21swapper/119:15:231
52899110,9cyclictest0-21swapper/100:00:231
52899110,3cyclictest0-21swapper/120:50:141
52899110,3cyclictest0-21swapper/119:30:131
52799118,2cyclictest16831-21diskmemload23:21:160
52799118,2cyclictest16831-21diskmemload23:21:160
52799118,2cyclictest0-21swapper/023:55:120
52799113,6cyclictest0-21swapper/019:56:020
52799113,6cyclictest0-21swapper/019:10:520
52799112,6cyclictest0-21swapper/020:36:580
52799112,6cyclictest0-21swapper/019:30:590
52799112,6cyclictest0-21swapper/000:28:020
52799112,6cyclictest0-21swapper/000:28:010
52799110,2cyclictest0-21swapper/022:50:190
52799110,2cyclictest0-21swapper/019:45:170
52799110,10cyclictest0-21swapper/022:41:190
53099107,2cyclictest8499-21kworker/u8:020:00:053
53099107,2cyclictest5847-21kworker/u8:020:46:043
53099107,2cyclictest12548-21kworker/u8:120:58:043
53099107,2cyclictest0-21swapper/321:00:183
53099105,3cyclictest26053-21ntpq20:10:163
53099102,6cyclictest0-21swapper/320:30:253
53099100,3cyclictest4575-21sendmail19:20:003
52899102,5cyclictest0-21swapper/119:51:591
52899100,8cyclictest0-21swapper/120:25:111
5299991,6cyclictest3130-21df20:35:122
5279994,3cyclictest9915-21open_inodes20:50:180
5279992,6cyclictest0-21swapper/019:50:230
5279991,6cyclictest0-21swapper/020:55:250
6849281,3sleep06634-21apt-get19:25:000
5309984,2cyclictest5634-21missed_timers20:40:173
5279984,2cyclictest29221-21aten2.4-expect20:20:120
5279981,6cyclictest0-21swapper/020:31:020
5279980,2cyclictest0-21swapper/021:05:040
5279980,2cyclictest0-21swapper/019:40:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional