Swiftpack.co - Package - shogo4405/HaishinKit.swift

HaishinKit (formerly lf)

Platform Language CocoaPods GitHub license

  • Camera and Microphone streaming library via RTMP, HLS for iOS, macOS, tvOS.
  • Issuesの言語は、英語か、日本語でお願いします!

Features

RTMP

  • ☑ Authentication
  • ☑ Publish and Recording (H264/AAC)
  • Playback (Beta)
  • ☑ Adaptive bitrate streaming
    • ☑ Handling (see also #126)
    • ☑ Automatic drop frames
  • ☐ Action Message Format
    • ☑ AMF0
    • ☐ AMF3
  • ☑ SharedObject
  • ☑ RTMPS
    • ☑ Native (RTMP over SSL/TLS)
    • Tunneled (RTMPT over SSL/TLS) (Technical Preview)
  • RTMPT (Technical Preview)
  • ReplayKit Live as a Broadcast Upload Extension (Technical Preview)

HLS

  • ☑ HTTPService
  • ☑ HLS Publish

Rendering

|-|HKView|GLHKView|MTHKView| |-|:---:|:---:|:---:| |Engine|AVCaptureVideoPreviewLayer|OpenGL ES|Metal| |Publish|○|○|◯| |Playback|×|○|◯| |VIsualEffect|×|○|◯| |Condition|Stable|Stable|Beta|

Others

  • Support tvOS 10.2+ (Technical Preview)
    • tvOS can't publish Camera and Microphone. Available playback feature.
  • ☑ Hardware acceleration for H264 video encoding, AAC audio encoding
  • ☑ Support "Allow app extension API only" option
  • ☐ ~~Support GPUImage framework (~> 0.5.12)~~
    • ~~https://github.com/shogo4405/GPUHaishinKit.swift/blob/master/README.md~~
  • ☐ ~~Objective-C Bridging~~

Requirements

|-|iOS|OSX|tvOS|XCode|Swift|CocoaPods|Carthage| |:----:|:----:|:----:|:----:|:----:|:----:|:----:|:----:| |1.1.0+|9.0+|10.11+|10.2+|12.0+|5.0+|1.5.0+|0.29.0+| |1.0.0+|8.0+|10.11+|10.2+|11.0+|5.0+|1.5.0+|0.29.0+| |0.11.0+|8.0+|10.11+|10.2+|10.0+|5.0|1.5.0+|0.29.0+|

Cocoa Keys

Please contains Info.plist.

iOS 10.0+

  • NSMicrophoneUsageDescription
  • NSCameraUsageDescription

macOS 10.14+

  • NSMicrophoneUsageDescription
  • NSCameraUsageDescription

Installation

*Please set up your project Swift 5.3. *

CocoaPods

source 'https://github.com/CocoaPods/Specs.git'
use_frameworks!

def import_pods
    pod 'HaishinKit', '~> 1.1.0'
end

target 'Your Target'  do
    platform :ios, '9.0'
    import_pods
end

Carthage

github "shogo4405/HaishinKit.swift" ~> 1.1.0

Swift Package Manager

https://github.com/shogo4405/HaishinKit.swift

License

BSD-3-Clause

Donation

Paypal

  • https://www.paypal.me/shogo4405

Bitcoin

3FnjC3CmwFLTzNY5WPNz4LjTo1uxGNozUR

Prerequisites

Make sure you setup and activate your AVAudioSession.

import AVFoundation
let session = AVAudioSession.sharedInstance()
do {
    // https://stackoverflow.com/questions/51010390/avaudiosession-setcategory-swift-4-2-ios-12-play-sound-on-silent
    if #available(iOS 10.0, *) {
        try session.setCategory(.playAndRecord, mode: .default, options: [.defaultToSpeaker, .allowBluetooth])
    } else {
        session.perform(NSSelectorFromString("setCategory:withOptions:error:"), with: AVAudioSession.Category.playAndRecord, with: [
            AVAudioSession.CategoryOptions.allowBluetooth,
            AVAudioSession.CategoryOptions.defaultToSpeaker]
        )
        try session.setMode(.default)
    }
    try session.setActive(true)
} catch {
    print(error)
}

RTMP Usage

Real Time Messaging Protocol (RTMP).

let rtmpConnection = RTMPConnection()
let rtmpStream = RTMPStream(connection: rtmpConnection)
rtmpStream.attachAudio(AVCaptureDevice.default(for: AVMediaType.audio)) { error in
    // print(error)
}
rtmpStream.attachCamera(DeviceUtil.device(withPosition: .back)) { error in
    // print(error)
}

let hkView = HKView(frame: view.bounds)
hkView.videoGravity = AVLayerVideoGravity.resizeAspectFill
hkView.attachStream(rtmpStream)

// add ViewController#view
view.addSubview(hkView)

rtmpConnection.connect("rtmp://localhost/appName/instanceName")
rtmpStream.publish("streamName")
// if you want to record a stream.
// rtmpStream.publish("streamName", type: .localRecord)

Settings

var rtmpStream = RTMPStream(connection: rtmpConnection)

rtmpStream.captureSettings = [
    .fps: 30, // FPS
    .sessionPreset: AVCaptureSession.Preset.medium, // input video width/height
    // .isVideoMirrored: false,
    // .continuousAutofocus: false, // use camera autofocus mode
    // .continuousExposure: false, //  use camera exposure mode
    // .preferredVideoStabilizationMode: AVCaptureVideoStabilizationMode.auto
]
rtmpStream.audioSettings = [
    .muted: false, // mute audio
    .bitrate: 32 * 1000,
]
rtmpStream.videoSettings = [
    .width: 640, // video output width
    .height: 360, // video output height
    .bitrate: 160 * 1000, // video output bitrate
    .profileLevel: kVTProfileLevel_H264_Baseline_3_1, // H264 Profile require "import VideoToolbox"
    .maxKeyFrameIntervalDuration: 2, // key frame / sec
]
// "0" means the same of input
rtmpStream.recorderSettings = [
    AVMediaType.audio: [
        AVFormatIDKey: Int(kAudioFormatMPEG4AAC),
        AVSampleRateKey: 0,
        AVNumberOfChannelsKey: 0,
        // AVEncoderBitRateKey: 128000,
    ],
    AVMediaType.video: [
        AVVideoCodecKey: AVVideoCodecH264,
        AVVideoHeightKey: 0,
        AVVideoWidthKey: 0,
        /*
        AVVideoCompressionPropertiesKey: [
            AVVideoMaxKeyFrameIntervalDurationKey: 2,
            AVVideoProfileLevelKey: AVVideoProfileLevelH264Baseline30,
            AVVideoAverageBitRateKey: 512000
        ]
        */
    ],
]

// 2nd arguemnt set false
rtmpStream.attachAudio(AVCaptureDevice.default(for: AVMediaType.audio), automaticallyConfiguresApplicationAudioSession: false)

Authentication

var rtmpConnection = RTMPConnection()
rtmpConnection.connect("rtmp://username:password@localhost/appName/instanceName")

Screen Capture

// iOS
rtmpStream.attachScreen(ScreenCaptureSession(shared: UIApplication.shared))
// macOS
rtmpStream.attachScreen(AVCaptureScreenInput(displayID: CGMainDisplayID()))

HTTP Usage

HTTP Live Streaming (HLS). Your iPhone/Mac become a IP Camera. Basic snipet. You can see http://ip.address:8080/hello/playlist.m3u8

var httpStream = HTTPStream()
httpStream.attachCamera(DeviceUtil.device(withPosition: .back))
httpStream.attachAudio(AVCaptureDevice.defaultDevice(withMediaType: AVMediaTypeAudio))
httpStream.publish("hello")

var hkView = HKView(frame: view.bounds)
hkView.attachStream(httpStream)

var httpService = HLSService(domain: "", type: "_http._tcp", name: "HaishinKit", port: 8080)
httpService.startRunning()
httpService.addHTTPStream(httpStream)

// add ViewController#view
view.addSubview(hkView)

FAQ

Do you support me via Email?

Yes. Consulting fee is $50/1 incident. I don't recommend. Please consider to use Issues.

Reference

  • Adobe’s Real Time Messaging Protocol
    • http://www.adobe.com/content/dam/Adobe/en/devnet/rtmp/pdf/rtmp_specification_1.0.pdf
  • Action Message Format -- AMF 0
    • https://www.adobe.com/content/dam/acom/en/devnet/pdf/amf0-file-format-specification.pdf
  • Action Message Format -- AMF 3
    • https://www.adobe.com/content/dam/acom/en/devnet/pdf/amf-file-format-spec.pdf
  • Video File Format Specification Version 10
    • https://www.adobe.com/content/dam/acom/en/devnet/flv/video_file_format_spec_v10.pdf
  • Adobe Flash Video File Format Specification Version 10.1
    • http://download.macromedia.com/f4v/video_file_format_spec_v10_1.pdf

Github

link
Stars: 1874

Dependencies

Used By

Total: 0

Releases

- 2020-09-16 15:07:05

- 2020-09-16 15:04:49

- 2020-09-06 13:26:10

- 2020-08-23 14:18:08

- 2020-06-20 06:35:15

- 2020-05-14 12:55:27

- 2020-04-18 05:55:50

- 2020-03-15 13:15:05

  • Hotfix 1.0.6
    • Fix unstable connection to a RTMP service.

- 2020-03-08 09:28:27

- 2020-02-29 05:30:15

- 2020-02-02 14:22:05

- 2020-01-19 16:03:25

- 2020-01-04 07:25:25

- 2019-12-01 09:32:48

- 2019-09-15 11:34:03

- 2019-09-01 06:25:38

- 2019-08-20 16:33:35

Hotfix 0.11.6

- 2019-08-10 05:44:56

- 2019-07-28 05:48:16

- 2019-07-20 06:51:44

- 2019-07-13 06:41:35

- 2019-06-22 08:43:50

- 2019-05-03 13:13:46

- 2019-04-14 07:57:29

- 2019-03-31 17:33:02

- 2019-03-24 17:22:58

- 2019-01-05 09:26:42

- 2018-12-09 19:54:09

- 2018-11-23 10:56:01