You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 23:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun Nov 23, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6020212097,18sleep00-21swapper/007:05:440
6228211999,15sleep10-21swapper/107:08:211
6314211696,15sleep30-21swapper/307:09:273
6029211493,16sleep20-21swapper/207:05:502
263012820,0sleep00-21swapper/011:31:130
226312810,1sleep0101ktimersoftd/009:44:140
75692790,1sleep37573-21timerandwakeup12:20:263
69012740,0sleep30-21swapper/311:45:183
50162730,0sleep20-21swapper/208:25:132
317512730,1sleep10-21swapper/109:53:571
317512730,1sleep10-21swapper/109:53:561
8892670,0sleep00-21swapper/012:14:460
638999300,28cyclictest0-21swapper/210:15:142
6388992715,10cyclictest0-21swapper/107:50:121
305782270,1sleep00-21swapper/011:01:010
6390992318,2cyclictest19578-21kworker/u8:011:57:053
6390992318,2cyclictest19578-21kworker/u8:011:57:053
244472230,1sleep30-21swapper/310:55:153
12852230,0sleep00-21swapper/010:30:160
6390992219,2cyclictest19578-21kworker/u8:011:41:053
638799220,20cyclictest5129-21runrttasks11:25:110
120522220,0sleep20-21swapper/210:06:412
6390992118,2cyclictest26582-21kworker/u8:010:24:053
6390992117,2cyclictest21215-21kworker/u8:210:17:043
6390992017,2cyclictest8869-21kworker/u8:111:14:053
6390992017,2cyclictest7169-21kworker/u8:112:27:043
6390992017,2cyclictest26989-21kworker/u8:210:10:053
6390992017,2cyclictest26099-21kworker/u8:111:06:023
6390992017,2cyclictest24822-21kworker/u8:109:24:063
6390992017,2cyclictest14569-21kworker/u8:211:28:053
6390992017,2cyclictest10741-21kworker/u8:107:33:043
639099201,2cyclictest0-21swapper/309:17:033
639099200,15cyclictest0-21swapper/309:45:043
639099200,15cyclictest0-21swapper/309:45:043
639099200,15cyclictest0-21swapper/308:52:033
638999200,2cyclictest0-21swapper/210:25:132
638999200,2cyclictest0-21swapper/208:40:112
638799200,2cyclictest0-21swapper/010:25:130
6390991916,2cyclictest8869-21kworker/u8:111:17:053
6390991916,2cyclictest4844-21kworker/u8:110:02:043
6390991916,2cyclictest4225-21kworker/u8:110:35:053
6390991916,2cyclictest31704-21kworker/u8:009:54:043
6390991916,2cyclictest31704-21kworker/u8:009:54:043
6390991916,2cyclictest31324-21kworker/u8:210:40:053
6390991916,2cyclictest30419-21kworker/u8:207:13:043
6390991916,2cyclictest27015-21kworker/u8:312:17:053
6390991916,2cyclictest26266-21kworker/u8:111:35:053
6390991916,2cyclictest24716-21kworker/u8:107:55:043
6390991916,2cyclictest16839-21kworker/u8:007:37:043
6390991916,2cyclictest15104-21kworker/u8:209:00:043
6390991916,2cyclictest14351-21kworker/u8:207:54:003
6390991916,2cyclictest12507-21kworker/u8:008:46:043
6390991916,2cyclictest10741-21kworker/u8:107:22:043
639099190,18cyclictest0-21swapper/312:34:053
159722190,1sleep20-21swapper/207:30:252
6390991815,2cyclictest8082-21kworker/u8:209:30:043
6390991815,2cyclictest6331-21kworker/u8:008:33:043
6390991815,2cyclictest31324-21kworker/u8:210:46:053
6390991815,2cyclictest24716-21kworker/u8:108:06:013
6390991815,2cyclictest23135-21kworker/u8:212:38:043
6390991815,2cyclictest21154-21kworker/u8:209:06:013
6390991815,2cyclictest16167-21kworker/u8:110:25:053
6390991815,2cyclictest14351-21kworker/u8:207:46:013
6390991815,2cyclictest13437-21kworker/u8:009:37:053
639099180,2cyclictest0-21swapper/311:21:043
639099180,2cyclictest0-21swapper/310:08:053
638999180,2cyclictest0-21swapper/210:20:122
638999180,16cyclictest4744-21sh09:25:142
189532180,0sleep20-21swapper/211:59:042
189532180,0sleep20-21swapper/211:59:042
6390991714,2cyclictest8875-21kworker/u8:208:35:043
6390991714,2cyclictest30719-21kworker/u8:208:23:043
6390991714,2cyclictest30419-21kworker/u8:207:19:043
6390991714,2cyclictest26989-21kworker/u8:209:59:043
6390991714,2cyclictest24822-21kworker/u8:109:27:043
6390991714,2cyclictest16839-21kworker/u8:007:40:043
6390991714,2cyclictest12507-21kworker/u8:008:44:043
6390991713,2cyclictest22619-21kworker/u8:008:10:043
639099170,2cyclictest0-21swapper/310:50:053
6388991712,3cyclictest0-21swapper/109:15:381
638899171,14cyclictest0-21swapper/110:57:271
6390991613,2cyclictest6331-21kworker/u8:008:27:033
6390991613,2cyclictest15104-21kworker/u8:208:55:053
639099160,9cyclictest0-21swapper/311:54:053
639099160,2cyclictest0-21swapper/309:40:043
6389991611,3cyclictest0-21swapper/209:35:012
6388991611,3cyclictest15656-21sensors_temp10:10:261
6387991611,3cyclictest14132-21ssh12:28:130
6390991512,2cyclictest632-21kworker/u8:108:18:043
6390991512,2cyclictest26582-21kworker/u8:010:30:033
639099150,2cyclictest0-21swapper/312:08:053
638899152,7cyclictest0-21swapper/109:40:011
6388991512,2cyclictest0-21swapper/107:40:271
6388991511,2cyclictest0-21swapper/110:50:151
6388991510,3cyclictest5010-21snmpd12:39:241
6388991510,3cyclictest13429-21ssh10:08:581
638899150,3cyclictest13729-21cut07:25:231
638899150,13cyclictest5764-21aten2.4-expect11:10:121
638899150,13cyclictest22789-21diskmemload11:23:471
638899150,13cyclictest0-21swapper/111:39:261
638899150,13cyclictest0-21swapper/110:47:361
638799152,7cyclictest0-21swapper/009:05:000
6387991510,3cyclictest0-21swapper/012:00:250
6387991510,3cyclictest0-21swapper/012:00:250
638799150,13cyclictest26266-21kworker/u8:111:35:170
638799150,13cyclictest0-21swapper/010:07:300
639099140,3cyclictest24603-21df11:30:143
639099140,2cyclictest0-21swapper/312:04:053
639099140,2cyclictest0-21swapper/312:04:043
639099140,13cyclictest0-21swapper/309:11:383
6389991411,2cyclictest0-21swapper/211:22:112
638999140,2cyclictest0-21swapper/212:35:522
638999140,12cyclictest0-21swapper/210:35:422
638999140,12cyclictest0-21swapper/209:58:412
638899143,7cyclictest0-21swapper/110:03:531
638899142,9cyclictest0-21swapper/112:26:581
638899142,7cyclictest0-21swapper/109:25:001
638899142,7cyclictest0-21swapper/108:35:001
638899142,6cyclictest0-21swapper/108:00:001
638899141,2cyclictest5129-21runrttasks12:15:381
6388991411,2cyclictest0-21swapper/110:30:181
638899141,11cyclictest22789-21diskmemload11:45:201
6388991410,2cyclictest0-21swapper/109:05:221
638899140,2cyclictest0-21swapper/112:02:471
638899140,2cyclictest0-21swapper/112:02:471
638899140,2cyclictest0-21swapper/111:33:091
638899140,2cyclictest0-21swapper/111:03:271
638899140,2cyclictest0-21swapper/109:47:081
638899140,2cyclictest0-21swapper/109:47:081
638899140,11cyclictest0-21swapper/107:13:591
638799149,3cyclictest0-21swapper/011:55:250
638799149,3cyclictest0-21swapper/011:55:240
638799142,8cyclictest0-21swapper/008:15:000
638799142,7cyclictest0-21swapper/011:25:000
638799142,7cyclictest0-21swapper/011:05:000
638799140,3cyclictest11683-21ssh11:50:250
638799140,12cyclictest5010-21snmpd09:48:500
638799140,12cyclictest5010-21snmpd09:48:500
638799140,12cyclictest3818-21switchtime08:20:260
638799140,12cyclictest22789-21diskmemload09:30:170
638799140,12cyclictest0-21swapper/012:30:190
638799140,12cyclictest0-21swapper/011:45:180
638799140,12cyclictest0-21swapper/011:16:150
638799140,12cyclictest0-21swapper/010:10:220
184212140,2sleep00-21swapper/010:49:000
6390991310,2cyclictest27015-21kworker/u8:312:10:053
639099130,2cyclictest0-21swapper/311:04:083
638999139,2cyclictest0-21swapper/208:15:262
6389991310,2cyclictest0-21swapper/212:18:272
6389991310,2cyclictest0-21swapper/210:04:332
638999130,2cyclictest22789-21diskmemload10:48:512
638999130,12cyclictest0-21swapper/212:28:412
638999130,12cyclictest0-21swapper/212:20:422
638999130,12cyclictest0-21swapper/211:53:522
638999130,12cyclictest0-21swapper/211:37:522
638999130,12cyclictest0-21swapper/211:27:022
638999130,12cyclictest0-21swapper/210:50:192
638999130,11cyclictest0-21swapper/211:42:362
638999130,11cyclictest0-21swapper/209:54:352
638999130,11cyclictest0-21swapper/209:54:352
638899138,3cyclictest22789-21diskmemload10:40:171
638899138,3cyclictest22789-21diskmemload09:20:121
638899132,6cyclictest0-21swapper/110:20:011
638899132,6cyclictest0-21swapper/107:20:001
6388991310,2cyclictest0-21swapper/111:15:171
6388991310,2cyclictest0-21swapper/110:27:581
6388991310,2cyclictest0-21swapper/109:55:281
6388991310,2cyclictest0-21swapper/109:30:151
638899130,2cyclictest0-21swapper/111:44:071
638899130,2cyclictest0-21swapper/110:35:161
638899130,12cyclictest0-21swapper/112:06:371
638899130,12cyclictest0-21swapper/111:06:121
638899130,11cyclictest22789-21diskmemload12:30:491
638899130,11cyclictest22789-21diskmemload10:20:021
638899130,11cyclictest0-21swapper/112:10:351
638899130,11cyclictest0-21swapper/111:25:111
638799139,2cyclictest0-21swapper/009:55:440
638799132,6cyclictest0-21swapper/007:50:000
638799131,3cyclictest0-21swapper/008:50:000
6387991310,2cyclictest0-21swapper/012:20:490
6387991310,2cyclictest0-21swapper/012:15:480
6387991310,2cyclictest0-21swapper/012:05:180
6387991310,2cyclictest0-21swapper/011:40:180
6387991310,2cyclictest0-21swapper/011:10:110
6387991310,2cyclictest0-21swapper/009:51:290
6387991310,2cyclictest0-21swapper/009:51:280
6387991310,2cyclictest0-21swapper/009:39:500
6387991310,2cyclictest0-21swapper/009:21:140
6387991310,2cyclictest0-21swapper/009:15:410
6387991310,2cyclictest0-21swapper/008:30:240
638799130,2cyclictest0-21swapper/009:12:310
638799130,12cyclictest0-21swapper/010:56:020
638799130,12cyclictest0-21swapper/010:53:400
51842130,2sleep20-21swapper/211:09:552
234202130,2sleep00-21swapper/012:38:120
118532130,2sleep20-21swapper/210:40:452
638999129,2cyclictest0-21swapper/212:33:452
638999129,2cyclictest0-21swapper/212:10:182
638999129,2cyclictest0-21swapper/210:55:112
638999129,2cyclictest0-21swapper/209:40:172
638999129,2cyclictest0-21swapper/207:40:182
638999129,2cyclictest0-21swapper/207:15:142
638999122,7cyclictest0-21swapper/211:02:592
638999122,7cyclictest0-21swapper/208:21:022
638999122,7cyclictest0-21swapper/208:06:022
638999122,7cyclictest0-21swapper/207:50:012
638999122,7cyclictest0-21swapper/207:46:592
638999121,7cyclictest5911-21gdm-simple-gree07:35:592
638999120,7cyclictest0-21swapper/207:29:012
638999120,2cyclictest22789-21diskmemload10:10:562
638999120,2cyclictest14941-21munin-node2
638999120,2cyclictest0-21swapper/212:04:442
638999120,2cyclictest0-21swapper/212:04:432
638999120,2cyclictest0-21swapper/209:35:332
638999120,11cyclictest22789-21diskmemload11:30:532
638999120,11cyclictest0-21swapper/212:05:342
638999120,11cyclictest0-21swapper/211:15:132
638999120,11cyclictest0-21swapper/211:10:142
638999120,11cyclictest0-21swapper/209:45:432
638999120,11cyclictest0-21swapper/209:45:432
638999120,11cyclictest0-21swapper/209:20:202
638999120,11cyclictest0-21swapper/209:10:242
638999120,11cyclictest0-21swapper/209:05:132
638899129,2cyclictest0-21swapper/112:21:501
638899129,2cyclictest0-21swapper/111:59:381
638899129,2cyclictest0-21swapper/111:59:371
638899129,2cyclictest0-21swapper/108:50:181
638899129,2cyclictest0-21swapper/108:20:131
638899127,3cyclictest0-21swapper/108:15:141
638899127,3cyclictest0-21swapper/107:20:241
638899121,9cyclictest14690-21munin-node1
638899120,2cyclictest0-21swapper/111:51:141
638899120,11cyclictest0-21swapper/108:05:131
638799129,2cyclictest0-21swapper/010:40:300
638799129,2cyclictest0-21swapper/008:43:350
638799129,2cyclictest0-21swapper/008:05:200
638799129,2cyclictest0-21swapper/007:10:260
638799127,3cyclictest5351-21ssh10:35:120
638799122,7cyclictest0-21swapper/007:21:590
638799121,6cyclictest0-21swapper/009:05:000
638799120,2cyclictest0-21swapper/010:15:150
638799120,2cyclictest0-21swapper/010:01:020
638799120,2cyclictest0-21swapper/007:45:130
638799120,11cyclictest0-21swapper/010:21:340
638799120,11cyclictest0-21swapper/009:26:190
96152110,2sleep00-21swapper/007:15:210
639099112,6cyclictest0-21swapper/308:00:593
638999118,2cyclictest0-21swapper/211:47:182
638999118,2cyclictest0-21swapper/210:33:092
638999118,2cyclictest0-21swapper/209:15:032
638999112,6cyclictest0-21swapper/209:02:592
638999112,6cyclictest0-21swapper/208:34:592
638999110,9cyclictest12443-21munin-run07:25:012
638899118,2cyclictest0-21swapper/108:25:121
638899116,3cyclictest20966-21munin-node1
638899116,3cyclictest0-21swapper/109:10:161
638899111,3cyclictest0-21swapper/108:35:231
638899110,9cyclictest17225-21tr08:55:131
638899110,6cyclictest0-21swapper/108:15:001
638899110,10cyclictest0-21swapper/109:35:381
638799118,2cyclictest0-21swapper/007:37:160
638799118,2cyclictest0-21swapper/007:30:260
638799112,6cyclictest0-21swapper/008:53:390
638799111,3cyclictest10464-21chrt08:37:170
638799110,4cyclictest14444-21cron07:30:010
638799110,2cyclictest0-21swapper/008:25:210
638799110,2cyclictest0-21swapper/007:59:090
638799110,10cyclictest0-21swapper/007:40:280
638999107,2cyclictest0-21swapper/208:55:132
638999107,2cyclictest0-21swapper/208:10:142
638999102,6cyclictest0-21swapper/207:13:102
638999102,2cyclictest0-21swapper/208:35:042
638899100,8cyclictest0-21swapper/108:45:141
638899100,8cyclictest0-21swapper/107:35:121
638899100,3cyclictest18980-21munin-node1
638799102,6cyclictest0-21swapper/008:58:390
63899996,2cyclictest0-21swapper/208:00:222
63899991,6cyclictest0-21swapper/207:55:262
63889991,6cyclictest0-21swapper/108:40:151
63889990,2cyclictest0-21swapper/107:55:131
63879991,6cyclictest0-21swapper/008:03:290
63879990,2cyclictest0-21swapper/008:19:470
63909983,3cyclictest39-21ksoftirqd/307:25:013
63899982,2cyclictest0-21swapper/208:47:052
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional